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this  report  to  illustrate  a  microcomputer-based  optical  processor  that  can  exploit  these 
advantages.  In  the  following,  we  shall  highlight  some  of  the  major  results  accomplished 
with  this  research  supported  by  AFOSR  Grant-86-0264,  which  covers  the  period  from 
August  1,  1986  to  September  30,  1987. 

We  have  developed  a  microcomputer-based  optical  processor  for  linear  transformation. 
The  technique  uses  the  systolic  array  processing  method,  such  that  various  types  of 
linear  transformations  can  be  carried  "Out  with  the  programmable  optical  system. 

We  have,  in  this  research,  developed  and  experimentally  demonstrated  that  Boolean 
logic- operations  can  be  performed  with  a  microcomputer-based  optical  architecture.  The 
technique  uses  magneto-optic  spatial  light  modulators  (MOSLMs)  for  logic  gates. 

We  have  also,  in  this  phase  of  research,  studied  the  effect  of  a  microchannel 
spatial  light  modulator  (MSLM)  under  partially  coherent  illumination.  A  variety  of 
optical  image  processing  operations  can  be  carried  out  with  the  MSLM  device.  Several 
image  processing  results  have  been  experimentally  illustrated. 

-  Concurrently,  we  have  also  developed  a  multichannel  optical  correlator.  This 
correlator  is  capable  of  performing  N  x  N  parallel  correlations,  which  has  a  processing 
capacity  of  more  than  400  times  over  the  conventional  optical  correlator. 

In  this  research,  we  have  also  accomplished  a  research  on  Boolean  logic  gates 
using  MSLM  and  liquid  crystal  televisions  (LCTVs) .  The  MSLM  is  used  as  an  adder,  an 
inverter,  a  subtractor,  or  a  buffer,  while  the  LCTVs  are  used  as  input  data  generators. 

The  sixteen  Boolean  functions  can  be  performed  rather  easily  with  the  hybrid  optical 
architecture. 

We  have  also  illustrated  a  technique  of  performing  binary  adder  with  a  microcomputer- 
based  optical  processor.  We  stress  that,  the  optical  binary  adder  is  a  basic  part  of 
the  central  processing  unit  in  a  digital-optical  computer.  An  experimental  result  shows 
that  a  4-bit  half-addition  can  be  implemented,  and  the  technique  can  be  extended  to 
perform  the  addition  on  larger  arrays  of  numbers  by  simply  changing  the  subroutines  of 
the  microcomputer. 

In  this  period  of  research,  we  have  developed  several  techniques  to  perform  matrix 
multiplication.  We  have  used  outer  products,  systolic-outer  product,  systolic-inner 
product  techniques  for  multiple-matrix  operation.  Bilinear  transformation  can  also  be 
carried  out  with  this  microcomputer-based  optical  architecture  (MOA) .  The  essential 
merits  of  the  MOA  must  be  the  high  accuracy  and  high  speed  performance. 

Remarks,  the  net  effects  of  this  study  is  to  emphasize  that,  by  exploiting  the 
efficient  operation  of  optics  and  the  programmability  of  electronic  computer,  it  is 
our  belief  that  the  microcomputer-based  optical  architecture  would  be  the  logical  approach 
toward  the  real-time  programmable  optical  processing  and  computing.  However,  much 
remains  to  be  done  in  the  development  of  electro-optical  devices  before  the  hybrid  optical 
processing  can  become  a  widespread  practical  reality.  It  is,  therefore,  hoping  that  this 
study  would  stimulate  the  interested  researchers  with  imaginative  approaches  toward  the 
hybrid  optical  computing  applications. 
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1.  Introduction 

We  have,  in  this  period  of  research  from  August  1,  1986  to 

September  30,  1987,  completed  the  major  tasks  in  the  area  on  "Study  of  a 

Microcomputer  Based  Real-Time  Programmable  Optical  Signal  Processor  and 
Application."  The  research  done  is  very  consistent  with  our  proposed 
program  to  the  Air  Force  Office  of  Scientific  Research  Grant  AFOSR-86-026^ . 
Several  of  research  findings  have  either  been  published  or  in  the  process 
to  be  published  in  open  literatures.  Several  of  the  results  have  also  be 
presented  in  various  scientific  conferences  and  meetings  (e.g..  Optical 
Society  Meeting,  SPIE,  and  ICO).  Sample  copies  of  these  papers  are 
included  in  this  report,  in  the  subsequent  sections,  to  provide  a  concise 

documentation  of  our  research  accomplishment  in  this  study.  In  the 

following  section,  we  shall  highlight  the  overall  research  done,  that 
covers  the  entire  period  of  this  funding  research.  A  list  of  publications 
resulting  from  this  support  is  included  at  the  end  of  this  report. 

2.  Summary  and  Overview 

2.1  Optical  Linear  Transformation  (Section  6) 

We  have,  in  this  period,  developed  a  microcomputer-based  optical 
linear  transformation  processing  technique.  The  technique  utilizes  a 
systolic  array  processing  method  to  perform  various  types  of  linear 
transformations,  such  as  discrete  Fourier  transformation,  discrete  Hilbert 
transformation,  discrete  chirp-Z  transformation  and  many  others.  By 
partially  parallel  addressing  two  magneto-optic  spatial  light  modulators 
(MOSLM),  this  proposed  system  would  offer  high  speed  and  parallel 
processing  capability  of  optics  and  programmability  of  microcomputer. 


L 


2.2  Real-Time  Signal  Detection  using  LCTV  (Section  ^4) 

In  this  research,  we  have  shown  that  a  color  liquid  crystal  television 
(LCTV)  can  be  used  for  color  pattern  recognition.  The  grid  structure  of 
the  display  panel  together  with  a  specially  designed  color  filter  provides 
spatially  isolated  polychromatic  spectra  to  enable  polychromatic  signal 
detection. 

We  have  found  a  serious  drawback  of  the  color  LCTV  which  is  the  lack 
of  space  Invariance,  even  after  it  has  been  immersed  in  a  liquid  gate. 

This  drawback  is  primarily  due  to  the  Inherent  color  filter  in  the  liquid 
crystal  display  and  the  phase  modulation  by  liquid  crystal  molecules.  A 
quantitative  investigation  of  space  variance  of  the  LCTV,  especially  the 
color  LCTV,  is  currently  being  studied.  /  _ 

We  have  used  a  multiple  matched  filtering  technique  to  improve  the 
correlation  signal.  However,  in  practice  the  diffraction  efficiencies  vary 
for  different  matched  spatial  filters.  The  Horner  efficiency  in  a  multiple 
matched  filtering  correlated  output  was  observed  to  be  approximately  30(«N) 
times  higher  than  the  single  matched  filtering  correlation  using  a  color 
LCTV.  With  the  aid  of  a  hard-clipping  signal.  With  further  improvements, 
the  color  LCTV  can  be  useful  for  color-sensitive  robotic  vision  and  other 
automatic  color  pattern  recognition  applications. 

2.3  Implementation  of  Symbolic  Substitution  (Section  5) 

Symbolic  substitution  is  essentially  a  combination  of  recognition  and 
substitution  phase.  Although  symbolic  substitution  is  not  restricted  to 
space  invariant  operations,  it  is  indeed  based  on  the  space  Invariant 
connectivity  of  optics.  A  method  of  optical  associative  memories  as 
applied  to  implement  a  symbolic  substitution  logic  is  proposed  in  this 
study.  The  merits  of  the  proposed  implementation  are  that  it  can  (1) 


handle  very  large  (SBP)  data,  (2)  perforin  any  substitution  in  one  simple 
step,  and  (3)  perform  multiple  instruction,  multiple  data  (MIMD)  operation 
using  a  multiplexed  hologram.  The  price  is  the  use  of  more  than  1  pixel 
(e.g.,  9  pixels)  to  encode  a  bit.  A  thresholding  process  may  be  required 
before  the  data  are  transferred  to  the  next  operation. 

We  have  also,  in  this  study,  experimentally  demonstrated  a  one-step 
holographic  associative  memory  as  applied  to  symbolic  substitution.  The 
linearity  of  multiple  holographic  filtering  is  abolished  in  practice.  The 
results  of  parallel  half-addition  are  illustrated.  We  note  that  parallel 
half-addition  is  an  example  of  multiple-instruction-multiple-data  (MIMD) 
operation. 

2.k  Optical  Parallel  Logic  Operation  (Section  6) 

We  have,  in  this  research,  experimentally  demonstrated  that  the 
sixteen  Boolean  logic  operations  can  be  performed  with  the  microcomputer 
based  optical  signal  processor  using  magneto-optic  spatial  light  modulators 
(MOSLMs).  The  parallel  logic,  which  includes  flip-flop,  half  adder,  full 
adder,  binary  image  subtraction  and  cellular  processing,  have  also  been 
demonstrated.  The  advantages  of  using  the  MOSLM  devices  are:  (1) 
electronically-addressability  and  microcomputer-programmability,  (2)  fast 
switching  time  («50us),  (3)  capability  of  storing  an  input  pattern  with-out 
power  supplied,  and  (^)  low  power  consumption.  Many  new  architectures  of 
hybrid  optical  processing  and  computing  may  be  implemented  using  MOSLMs 
based  on  the  proposed  technique. 

2.5  MicroChannel  Spatial  Light  Modulator  Processing  (Section  7) 

In  this  period  of  research,  we  have  investigated  the  signal  processing 
capability  using  a  microchannel  spatial  light  modulator  (MCSLM)  under 
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partially  coherent  light.  We  have  shown  that  the  MCSLM  provides  an 
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effective  means  of  performing  optical  processing  operations  in  color  under 
white-light  illumination.  Thf  external  crystal  plate  in  conjunction  with 
the  electro-optic  crystal  in  the  MSLM  plays  an  important  role  in  the  system 
by  performing  color  filtering,  and  allocating  some  colors  to  the  background 
and  others  to  the  object.  A  variety  of  operations  can  be  carried  out. 

Image  subtraction  and  edge  enhancement  have  been  demonstrated.  Color 
selection  and/or  reversal  can  be  obtained  by  rotating  the  external  crystal 
plate. 

The  system  or  its  expanded  version  can  potentially  be  valued  for  night 
vision,  medical  imaging,  and  interferometric  applications. 

2.6  Multichannel  Optical  Correlation  (Section  8) 

We  have,  in  this  research  program,  developed  a  multichannel  optical 
correlator  for  mass  image  correlation.  This  correlator  utilizes  reference 
beams  with  different  directions  in  construction  the  (MSFs).  Since  the 
output  correlation  diffraction  is  based  upon  the  direction  of  the  spatial 
carrier  frequency,  the  correlation  distribution  from  each  MSF  will  appear 
at  different  diffracted  locations.  Thus,  N  x  N  channels  can  be  synthesized 
by  employing  a  phase  mask  to  diffract  the  reference  beam  into  N  x  N 
directions.  Thus  a  parallel  optical  correlator,  which  has  a  processing 
capacity  of  more  than  i<00  times  over  the  conventional  signal  channel,  can 
be  constructed.  Since  the  correlation  outputs  are  diffracted  in  different 
locations,  the  output  signal-to-noise  (SNR)  is  independent  of  the  number  of 
channels.  This  technique  is  rather  easy  to  implement  since  no  mechanical 
scanner  is  used  for  the  mass  channel  correlations,  and  it  can  apply  to 
rapid  optical  mass  pattern  recognitions. 


2.7  Boolean  Logic  Gates  using  MSLM  and  LCTVs  (Section  9) 

We  have,  in  this  research  task,  developed  a  microcomputer  based 
optical  system  to  perform  binary  Boolean  logic,  using  a  microchannel 
spatial  light  modulators  (MSLM)  and  liquid  crystal  televisions  (LCTVs). 

The  logic  states  of  the  input  and  output  data  arrays  are  represented  by 
light  intensity.  Combining  the  merits  of  the  MSLM,  LCTVs  and  a  computer, 
the  system  offers  the  advantages  of  optical  parallel-processing  capability, 
programmability,  and  feedback  consecutive-processing  flexibility.  We 
notice  that  the  MSLM  is  used  as  an  adder,  an  Inverter,  a  subtracter,  or  a 
buffer.  We  used  three  liquid-crystal  televisions  with  a  computer  as  input 
interfacing  devices.  Through  the  use  of  its  feedback  loop,  the  system  can 
consecutively  execute  a  series  of  logic  operations. 

We  conclude  that,  with  advances  in  MSLM  performance,  the  performance 
of  this  optical  system  is  expected  to  improve,  resulting  in  faster 
response,  higher  resolution,  and  less  image  distortion. 

2.8  Optical  Binary  Adder  (Section  10) 

We  note  that  the  optical  binary  adder,  in  a  digital  optical  computer, 
is  a  basic  part  of  the  central  processing  unit  (CPU).  We  have,  in  this 
research  program,  developed  a  technique  of  implementing  an  optical 
half-adder  and  a  full  adder  utilizing  programmable  liquid  crystal 
televisions  (LCTV).  The  concept  of  constructing  an  optical  full  adder  is 
based  upon  the  realization  of  an  optical  read-only-memory  (OROM).  We  have 
experimentally  demonstrated  that  a  i<-bit  half-addition  can  be  implemented. 
The  results  reflect  the  general  case  for  half-addition.  Notice  that  the 
half-adder  can  be  easily  extended  to  perform  the  addition  on  larger  arrays 
of  numbers  by  changing  the  program  in  the  control  computer.  There  is  no 
extra  coding  processing  required  in  the  half-adder,  since  the  number  is  - 
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automatically  encoded  by  the  LCTV  into  the  directions  of  polarization.  To 
extend  a  half-adder  to  a  full  adder,  we  Introduced  an  OROM  to  realize  carry 
transmission  and  overflow  error  detection. 

2.9  Digital -Optical  Matrix  Multiplication  (Section  11) 

In  this  research  task,  we  have  developed  a  technique  to  perform 
multiple  binary  number  multiplication  in  parallel.  With  reference  to  the 
basic  approach,  two  optical  architectures  for  multiple  matrix 
multiplication  are  constructed.  Since  the  matrices  are  in  binary  or  mixed 
binary  form  and  the  processing  is  performed  in  parallel,  these  systems  have 
the  capability  to  perform  high  accuracy  and  high  speed  multiple  matrix 
multiplication.  Several  preliminary  experimental  demonstrations  have  been 
carried  out.  The  technique  involves  the  hybrid  optical  system  using 
real-time  SLM's  and  are  also  studied.  We  note  that  the  digital-optical 
architectures  can  also  be  applied  to  linear  and  bilinear  transformations 

2.10  Optical  Perfect  Shuffle  (Section  12) 

One  of  the  Inherent  advantages  of  the  optical  computer  is  its 
noninteractive  interconnecting  capability.  The  optical  perfect  shuffle 
(PS)  which  forms  the  basis  of  such  an  interconnection  network  is  a  useful 
concept  in  optical  computer  architecture.  In  this  phase  of  research,  we 
have  shown  that  an  optical  perfect  shuffle  can  be  easily  performed  by 
coherent  or  partially  coherent  spatial  filtering.  We  have  experimentally 
demonstrated  two  sets  of  input  data  (e.g.,  English  letters)  can  be  shuffled 
with  a  conventional  optical  filtering  technique.  The  input  data  can  be 
easily  generated  by  a  microcomputer  and  then  written  onto  programmable 
spatial  light  modulators. 
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2.11  Hybrid  Optical  Computing  (Section  13) 

We  have,  in  this  research  program.  Investigated  several  optical 
computing  architectures  with  a  microcomputer  based  optical  processor.  The 
basic  philosophy  of  the  approach  must  be  exploiting  the  efficient  operation 
of  optics  and  the  programmability  of  electronic  computer.  It  is  our  belief 
that  the  hybrid  optical  architecture  is  the  logical  approach  toward  modern 
optical  computing. 
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A  Hybrid  Optical  Systaa  ter  Linear  Trannforaation  Processing 

F.  T.  S.  Yu.  H.  r.  Cao  and  T.  W.  Lu 

tlectrical  tnginee-lng  Deparlaent 
Tne  Pennsylvania  Stale  University,  University  Park.  PA  16802 


Abstract 


A  elcrocoeputer-based  optical  llnea-  transformation  processing  systeit  Is  proposed.  The  technique 
utlllies  a  systolic  a“ray  processing  eethod  ’o  pe'fore  varjou.*  types  ot  linear  transformations,  suet  as 
discrete  Fourie-  transformation,  discrete  Kiloert  transformation,  discrete  chirp-Z  transformation  and  many 
others.  By  pa'tially  pa“allel  addressing  two  magneto'optlc  spatial  llgnt  modulators  (H.OSLM),  this  proposed 
system  would  offer  r.ign  speed  and  parallel  processing  capability  of  optics  and  programmabilty  of 
microcompuie" . 

^  .  Introduction 


Optical  signal  processing  was  initially  based  upon  the  two-dimensional  Fou-ie-  t-ansformation.  achievable 
with  a  lens,  howeve',  this  is  not  tne  only  optical  metnoc  to  perform  tne  Fou'ier  transform.  Mention,  must  be 
made  tnat  a  easi'-LEf  based  approach  was  subsequently  prooo.sed  by  Coooman'  and  Eroj^ley,  etc.^  to  compute  a  one 
dimensional  (10/  discrete  Fou-ie'  transform  (DFT).  By  conside-lng  ID  DPT  as  a  mat"ix-veclor  p-oduct,  they 
developed  an  elect-o-optical  processo-  (EOF;  with  a  masK  representing  the  transform  matrix  and  an  LEE 
representing  an  input  signal  sequence. 


In  this  pace',  we  would  propo.se  a  systolld  ar-ay  processing  technique  utilizing  two-cascaded 
magneto-optic  spatial  light  modulators  to  perform  the  discrete  linear  l-ansformatior.  (DLT).  We  will  show 
tnat  this  proposed  system  would  offer  the  advantages  of  programmability,  high  accuracy  and  high  speed 
parallel  processing  capability. 

2.  Tne  Discrete  Linea-  Transformation  (DLT) 

_ 

2.1.  Definition 

It  is  well  known  that  a  discrete  linear  system,  a.*  shown  in  Figure  1,  can  be  cha-aeterized  by  the 
response  h-^n,  to  an  impulse  at  me  input.  Tne  input-output  relationship  of  such  a  system  can  be  summarized 
by  tne  following  equation; 

N 

6m  ■  I  ^n  ^*tt,h»  ®  1  *  2,  ....  K.  (1) 

I  n-1 


Figure  1,  Input  and  output  functions  of  discrete 
linear  transformation  CELT;. 

In  other  woros.  the  output  sequence  igu)  and  input  secuence  |fn,’  can  be  considered  as  vectors,  such  t.nat 
Eq.  (i)  car,  be  expressed  in  matrix  form. 
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(3) 


The  set  of  impulse  response  represented  by  is  known  as  a  transfo-m  mat-ix  Ihus  different 

DLT  would  have  different  transform  matrices.  Let  us  now  illustrate  a  few  of  frequently  used  DLTs: 

2.I.I.  Dlsc-ete  Fou-le-  Transform  (DFT) 

The  DPT  is  defined  by 

.  K'1 


K  n 

n*0 


whe“e 


Bin] ,  0Sr.£N-l . 


~i?v  1 


exp  t^^mni. 


(B) 


(5) 


is  also  known  as  the  t'ansfo-r.  ke-nel.  In  o-de-  to  implement  the  DPT  t-ansfo-mation  in  a  elecfo-optical 
P’-ocesso-,  we  would  -epresent  tne  complex  transfo-m  matrix  in  -eal  elments.  The  corresponding  -eal  transform 
matrices  car.  be  written  as  ~ 


Fie 


m,n' 


t  r?-  • 

'  •  cos  mn. 


and 


t  ?r  ' 
"in  ijj-mnj. 


(6a) 


(6b) 


whicr.  are  tne  well  known  dise-ele  cosine  transfo."K  (DTT)  and  discrete  sine  transformation  (DST). 

Z.i.?,  gjsc-ete  Hilbe-t  T-ansfo-r  (DHT) 

It  IS  well  known  that  tne  relationship  between  the  real  and  imagina-y  oa-ts  of  an  analytic  signal  can  be 
oesc“ised  by  Kiioe't  t-ansfo-mation.  The  elements  of  a  discrete  Hllbe't  t'ansform  (DKT)  matrix  can  be 
written  as. 


2  •  slr.^rv(r-n)/;2 
T  im-ni 


B.n 


,  m-n»C, 
,  m-n»C 


(T) 


fisc-ete  Cr 


.  / 


Anothe"  frequently  used  linear  transfo'matior.  is  Chi”p-Z  t'an.*fc“m,  w.nich  can  be  used  to  compute  the  DPT 
coefficients.  The  elements  of  tne  DCIT  transform  mat~ix  can  be  written  as 


he^n  *  [ iv(m-n)^/N] . 


(6) 


We  note  that  this  type  of  shlft-i.nvariant  t.-ans.'c-matlon,  as  well  as  othe”  types  of  DLT  can  be 
implemented  by  an  electro-optical  processor  with  a  systolic  array  processing  technique. 


2.2. 


Imclemer.tatior  with  Systolic  A-rav  ^-ocessing 


fince  the  discrete  linear  transformation  can  be  viewed  as  result  from  a  matrix-vector  multiplication, 
the  systolic  array  processing  a-chilecture  car.  be  usee  fo-  the  icplementation  of  DLT.  Thus  by  compinlng  the 
systolic  array  processing  technique  and  tne  two's  complement  rep-eser.tation,  a  DLT  can  be  performed  with  a 
digital  optical  processor.  As  compa.-ed  with  the  analog  optical  processor,  tne  technique  that  we  will  propose 
would  have  high  accuracy  anc  low  error  rate.  And  it  is  compatible  with  other  digital  processors. 

2.2.1 .  Two's  Complement  fierresentation 


Two's  complement  representation  has  been  applied  fo-  imp-oving  tne  accu-acy  of  matrix  multiplication. 

This  teohnioue  allows  the  handling  of  both  positive  anc  negative  numbers.  A  detailed  discussion,  of  two's 
complement  arithmetic  car.  be  found  ir.  the  work  of  BoCKer,  Bromley  and  Dlayton.-  Let  us  now  briefly  oescrioe 
tne  concept  of  two's  complement  aritnoetlc. 

SPIB  Vo!  698  fiea/  Time  Sipnal  Processing  IX 11 9861  /  277 


Since  the  size  of  optlcel  processor  is  fixed,  the  two’s  complement  -ep'-esentation  used  in  digtal  optical 
processor  should  be  modified.  For  example,  the  decimal  numbers  '5.25  and  ♦13.375  would  have  a  t-aditlonal 
two's  complement  representation  such  as 


Decimal 

Pepresentatlon 


♦13.375 


T-aditional  Two's  Complement 
Rep^esentatlor 


J^OO .  11 
♦.sign  bit 
01101.011 
♦•sign  bit 


The  left-most  bit  is  a  sign  bit.  which  is  needed  for  two's  complement  -ep-esentation.  Fo-  fixed  size 


processor,  it  requires  the  input  numbers  be  represented  by  the  same  numbe-  of  bits.  F 
the  examples  discussed  above  should  be  -epresented  by  a  12  bit  representation  such  as 


For  a  12  bit  p-ocessor , 


Decimal 

Rec-esentation 


Optical  Two's  Complement 
Representation 


-3.25 

'I5.375 


11111110c. 110 
000001101.01 1 


In  ou"  proposed  system,  mixed  bina-y  representation  is  employed.  Tne  advantages  of  utilizing  the  mixed 
binary  representation  is  to  avoid  tne  carry  bit  in  optical  processing, _wnich  mave  tne  implementaion  much 
simpler. 

2.2.2.  Systolic  A— 'ay  P-ocessing 


We  note  that  systolic  a— 'ay  processing  is  suitable  fo-  pe-fo-ming  mat-ix-vector  multiplication, 
p-oposed  system,  we  would  utilize  the  systolic  array  technique  to  perform  va-ious  discrete  linea- 
transformations. 
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Figu-e  2. 


Examples  of  DIT  implementation  using  systolic  a-ray  processing. 

(a)  discrete  cosine  t-ansforoatior.  (CCT). 

(b)  discrete  sine  transformation  (DST). 

(c)  discrete  Hilbert  transformation  (DHT). 


Several  examples  of  DLT  using  the  systolic  array  processing  technique  e-e  illusfated  in  Figu-e  2.  In 
Figure  2!a),  a  discrete  cosine  t-ansform  (DCTi  matrix  is  encoded  in  two’s  coEple.ment  form  anc  multiplied  with 
input  vector  (signal)  using  systolic  array  method.  A  discrete  sine  transformation  (DFT)  carried  out  by 
systolic  array  metnod  is  also  shown  in  Figure  2(t).  Thus  by  comcining  DCT  anc  C2T  of  Figu-e  2ia)  and  (b),  a 
discrete  Fourier  transform  can  be  obtained.  Moreover,  the  systolic  e’'ray  formats  for  discrete  Hilbert 
transform  (DKT)  is  also  snown  in  Figure  2(c). 
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Elect~o-Optlcal  PUT  Proceywo-  Doign 


The  proposefl  nic-ocompute— based  digital  optical  DLT  processing  system  is  illustrated  in  Figure  3.  From 
this  figure,  we  see  that  two  cascaded  >agneto-optlc  spatial  light  aoculators  (MOSLM.)  are  utlllzec:  to  pe-fo-m 
systolic  a""ay  engagenent  section  and  a  CCD  array  detecto-  is  used  Ter-  time-integration. 

Since  MOSLK  can  be  add-essed  in  partial  pa-allel  mode,  the  whole  frame  pattern  on  MOSLK  car.  be  switched 
ve-y  fast  (e.g.,  50  us  for  a  512  x  512  MOSLK).'"^  By  prope-  design  of  a  high  speed  memory  subsystem  and  an 
interface  circuit,  a  relatively  slow  microcomputer  can  be  used  to  cont”ol  the  pa-allel  operation  fo-  large 
data,  which  would  "esult  in  highe”  operation  speed.  At  the  same  time,  the  flexiblity  of  man-machine 
Inte-actlon  of  mic-oeomputer  i.«  still  "etalned.  In  o-de-  to  gene'ate  the  systolic  ar-ay  patte-n  of  fansfo-ir 
mat-ix  rapidly,  these  pattern.*  are  sto~ed  in  a  high  speed  read  only  memory  (ROM),  while  the  input  signal 
sequence  is  conve“tec  by  a  high  speed  analog  to  digital  conve-te-  (if  input  is  analog  signal)  and  tnen  is 
formated  by  a  high  speed  paraliel-se'ial  buffer.  The  time-integration  operation  is  done  by  a  CCD  oetector, 
and  a  high  speed  serial-parallel  deformater  is  the"efore  needed.  By  controlling  the  microcomputer,  va'ious 
D’_T  systolic  patterns  can  be  selected,  for  which  the  related  DIT  can  be  perfo-med.  .Software  design  fo-  this 
proposed  DLT  processor  is  illustrated  by  a  flow  chart  in  Figure  *■. 
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Fostprocessing 
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Figure  A.  Flow  chart  of  main  program. 


Exoerimer-al  Demonstration 


In  order  to  verify  the  proposed  technique,  an  experimental  system  is  constructed.  For  experimental 
deraonstration,  soot  DLT  systolic  patterns  are  generated  onto  the  spatial  light  mooulators,  and  an  optical  RAK 
(OPRAM)  detector  is  used  with  an  Apple  He  computer  to  perform  engagement  processing.  Several  DLT  systolic 
patterns  are  illustrated  in  Figure  5  and  an  experimental  set  up  is  oepicted  in  Figure  6. 
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Real-time  polychromatic  signal  detection  using  a  color  liquid 
crystal  television 
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Subject  terms:  optical  informetion  processing;  color  pattern  recognition;  multiple 
matched  filtering:  real-time  device;  liquid  crystal  television. 


Abstract.  A  novel  low-cost  color  liquid  crystal  television  is  applied  in  a 
real-time  color  pattern  recognition  system.  In  this  system,  a  target  is 
identified  on  the  basis  of  both  shape  and  spectral  content.  A  multiple 
matched  filtering  technique  is  also  proposed  to  improve  the  detected 
correlation  signal.  Experimental  results  of  the  bichromatic  signal  detec¬ 
tion  are  presented. 
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1.  INTRODUCTION 

The  recent  appearance  of  a  low-cost  (~S100)  black-and-white 
liquid  crystal  television  fLCTV)  has  attracted  a  great  deal  of 
attention  to  explore  its  usefulness  for  real-time  optical  signal 
processing.'"’  It  is  undoubted  that  a  color  LCTV  (~S300)  can 
be  applied  to  real-time  optical  processing  as  well.  In  optical 
signal  processing,  polychromatic  signal  detection  is  signifi¬ 
cant  because  all  natural  objects  are  colored.  It  would  be  desir¬ 
able  to  have  a  detecting  system  capable  of  discriminating 
different  coiors  in  addition  to  different  shapes.  This  kind  of 
detecting  system  would  be  a  step  closer  to  artificial  intelli¬ 
gence  resembling  a  human  recognition  system.  In  this  paper 
we  present  the  application  of  color  LCTV  to  real-time  poly¬ 
chromatic  signal  detection. 

Color  pattern  recognition  has  been  performed  using  a  trans¬ 
mission-type  as  well  as  a  reflection-type  matched  spatial  filter 
(MSF)  by  Case*  and  by  Ishii  and  Murata.’  respectively.  Their 
techniques  used  color-sensitive  optical  filters  that  were  in 
essence  multiplexed  volume  holograms  as  proposed  by  Shi.'° 
The  utilization  of  a  prism  in  a  polychromatic  coherent  optical 
correlator  for  color  pattern  recognition  was  described  by 

Invited  Piper  IP- 101  received  Sep;  17.  1986;  revised  manuscript  received 
Dec  29.  1986.  accepted  for  publication  Jan.  12.  1987.  received  bv  Manaimc 
Editor  Feb  9.  1987. 
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Braunccker  and  Bryngdahl."  We  have  studied  polychromatic 
signal  detection  utilizing  a  diffraction  grating,'*  which  can 
also  be  performed  in  real  time  using  an  expensive  liquid 
crystal  light  valve  (LCLV).'^  ’*  In  this  method,  a  color  signal 
transparency  is  placed  in  contact  with  a  one-dimensional  sinu¬ 
soidal  diffraction  grating  at  the  input  plane  of  a  polychromatic 
coherent  optical  processor.  It  is  always  piossible  to  design  a 
diffraction  grating  such  that  the  first-order  spectra  of  the  red, 
green,  and  blue  (R,  C.  B)  wavelengths  are  adequately  sepa¬ 
rated.  If  a  set  of  color-sensitive  MSFs  is  properly  inserted  in 
the  Fourier  plane,  a  color  correlation  signal  can  be  detected  at 
the  output  plane  of  the  processor. 

2.  GENERAL  CONCEPT 

We  previously  noted  that  a  color  LCTV  can  be  applied  to 
real-time  optical  signal  processing.  With  proper  modification, 
a  disassembled  color  LCTV  is  suitable  for  the  diffraction 
method  in  polychromatic  signal  detection.  Because  the  dis¬ 
play  panel  of  an  LCTV  consists  of  a  tricolor  tred.  green,  blue) 
pixel  structure,  the  Fourier  transform  of  a  pattern  displayed 
on  the  LCTV  will  be  diffracted  into  many  orders.  Therefore,  a 
diffraction  grating  is  no  longer  needed.  However,  separations 
of  the  polychromatic  spectra  cannot  be  determined  freely. 

The  structure  of  the  display  panel  of  a  color  LCTV  is 
illustrated  in  Fig.  1(a).  The  corresponding  polychromatic 
spectra)  distribution  is  shown  schematically  in  Fig.  Kb).  Note 
that  the  first-order  spectra  of  different  colors  may  overlap. 
However,  assuming  that  the  four  first-order  spectra  have  the 
same  intensity,  isolated  polychromatic  spectra  can  be  ob¬ 
tained  by  superimposing  some  specific  color  filters  at  the 
Fourier  plane,  as  shown  in  Fig.  1(c).  Thus,  a  polychromatic 
signal  can  be  detected  by  three  primary  MSFs.  The  three 
primary  color  autocorrelation  spots  would  then  all  be  at  the 
same  position  on  the  output  plane  since  they  depend  only  on 
the  angle  of  the  reference  beam  in  the  MSF  synthesis. 

Figure  2  is  a  photograph  of  the  Fourier  transform  of  the 
display  panel  illuminated  by  red  laser  light.  It  was  observed 
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Fig.  1.  (a)  Struetura  of  color  LCTV  diaptay  panal.  (bl  Schamatic  dia- ' 
gram  of  polychromatic  tpactral  distribution  at  Fourier  transform 
plana,  ic)  Color  filtors  at  Fourier  transform  plana. 


Tig.  2.  Fourier  transform  of  the  display  panel  Illuminated  by  red  laser 
light. 

that  the  intensity  of  the  zero-order  spectrum  was  much 
stronger  than  that  of  the  higher  diffraction  orders.  The  zero- 
order  spectrum  was  utilized  in  the  monochromatic  signal  de¬ 
tection  using  a  black-and-white  LCTV.*-^*  In  theory,  the 
basic  concept  illustrated  in  Fig.  1(c)  will  provide  polychro¬ 
matic  signal  detection.  In  practice,  however,  the  first-order 
spectra  may  be  too  weak.  This  is  a  significant  difference 
between  the  inherent  grating  structure  of  the  LCTV  and  the 
sinusoidal  diffraction  grating  used  in  Ref.  8.  which  concen¬ 
trates  the  diffracted  light  into  the  first-order  spectra. 

3.  MULTIPLE  MATCHED  FILTERING  METHOD 

To  enhance  the  correlated  output  signal,  a  multiple  matched 
filtering  technique  is  proposed.  In  this  technique,  man)  spec¬ 
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Fig.  3.  Color  filters  at  Fourier  transform  plane  proposed  for  multiple 
matched  filtering  method:  lal  polychromatic  correlation,  lb)  bichro- 
matic  correlation.  Id  Color  filters  actually  used  for  bichromatic  cor¬ 
relation  based  on  multiple  matched  filtering  method. 


0  =0 


^  _ [ 


Fig.  4.  la)  Autocorrelation  of  a  window  function,  lb)  Autocorrelation 
of  a  sampled  window  function.  Ic)  Hard-clipping  process. 


tra  are  utilized  simuliancously  instead  of  only  one.  as  shown 
in  Fig.  3(a).  The  Fourier  plane  is  divided  into  four  quadrants 
covered  by  red.  green,  and  blue  filters  and  an  opaque  stop.  In 
this  arrrangement.  a  higher  than  normal  Homer  efficiency, 
which  is  the  ratio  of  autocorrelation  output  power  and  input 
power,  can  be  expected.  For  the  sake  of  simplicity,  a  bichro¬ 
matic  correlation  (red  and  green)  will  be  performed  to  verify 
the  proposed  technique.  To  utilize  diffracted  light  efficiently, 
a  configuration  of  color  filters  as  shown  in  Fig.  3(b)  may  be 
used  at  the  Fourier  plane.  However,  the  configuration  shown 
in  Fig.  3(c)  is  preferred  because  it  approximates  the  one  in 
Fig.  3(a),  i.e..  only  one  axis  is  covered  by  each  color  filter. 

We  now  consider  the  correlation  signal  of  the  multiple 
matched  filtering  technique.  Figure  4(a)  shows  the  autocor¬ 
relation  of  a  window  function,  and  Fig.  4(b)  shows  the  auto¬ 
correlation  of  a  sampled  window  function.  Comparing  these 
autocorrelations,  we  see  that  (1 )  the  autocorrelation  in  (bl  is 
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also  sampled,  (2)  the  width  of  the  envelope  in  (b)  is  the  same 
I  as  that  in  (a);  and  (3)  the  peak  height  of  the  envelope  m  (b)  is 
I  half  that  in  (a). 

Since  the  input  signal  displayed  on  the  LCTV  is  a  sampled 
pattern  due  to  the  inherent  grating  structure,  multiple  spectra 
are  produced  at  the  Fourier  plane.  If  only  one  spectrum  is 
matched  with  an  MSF.  it  is  essentially  a  correlation  similar  to 
that  shown  in  Fig.  4(a),  with  a  very  low  peak  height.  If  all  of 
the  spectra  are  matched  with  the  proper  MSFs.  we  would  have 
a  correlation  peak  similar  to  that  in  Fig.  4(bl  but  with  a  higher 
peak  height.  Approximately  N  matched  spectra  split  the  cor¬ 
relation  spot  into  N  subpeaks.  The  most  important  feature  is 
that  the  height  of  the  main  peak  increases  by  N*  while  the 
width  of  the  envelope  of  the  correlation  signal  remains  un¬ 
changed.  To  improve  the  detectability  of  the  correlation  sig¬ 
nal.  a  hard-clipping  process  can  be  done  using  an  image 
digitizer  to  depress  all  subpeaks  except  the  main  one,  as 
shown  schematically  in  Fig.  4(c).  A  similar  hard-clipping 
technique  has  proved  effective  in  other  applications. An 
alternative  process  also  can  be  done  to  integrate  subpeaks  so 
that  an  averaged  spot  is  obtained.  We  note  that  this  averaged 
spot  is  approximately  the  same  size  as  a  single  matched  filter¬ 
ing  correlation  spot. 

In  addition,  the  multiple  matched  filtering  technique  makes 
it  possible  to  match  the  entire  frequency  content  of  the  object. 
Because  of  the  limitation  of  the  dynamic  range  in  a  photo¬ 
graphic  process,  an  MSF  is  usually  synthesized  for  a  narrow 
frequency  band.  By  multiple  matched  filtering,  each  MSF 

I  contributes  a  different  frequency  content.  Thus,  it  takes  us  a 
step  closer  to  complete  frequency  matched  filtering.  For  illus¬ 
tration.  Fig.  5  depicts  a  series  of  impulse  responses  of  the 
synthesized  MSFs  of  a  letter  P. 


Fig.  6.  Schematic  diagram  of  optical  aetup  tor  polychromatic  signal 
detection. 


s(x.y;X)  =  s^x,y)exp|i6(x.y)]i,(x.y)  s,(x,y )exp|i*(x.y))tp(x,y) 

+  Sb(x.yiexp(i<f>(x.y))ib(x.y)  .  fl) 

where  s,,  s^,  and  Sb  are  the  red.  green,  and  blue  complex  am¬ 
plitude  iransmittances  of  the  input  pattern;  M*-  >’)•  t^lx.  y). 
and  tb(x,  y)  arc  the  red.  green,  and  blue  sampling  functions; 
and  *(x,  y)  represents  the  inherent  phase  variation  of  the 
liquid  crysul  that  cannot  be  compensated  by  a  liquid  gate. 
The  sampling  functions  are 


Mx.y)  =  ^]^C„„exp  -i  -h 


4.  MATHEMATICAL  DESCRIPTIO.N 

A  mathematical  description  may  be  required  to  support  the 
physical  concept  described  above.  Figure  6  is  a  schematic  of 
the  proposed  optical  setup.  Suppose  that  the  color  displav  of 
the  LCTV  IS  constructed  as  in  Fig,  1(a).  The  complex  light 
amplitude  distribution  behind  the  input  plane  can  be  described 
as 


t,(x.y) 


V  Vr-  /  r  ni(x-Ax) 

2<2<C„„exp  ( -1  - 

m  n  I.  L  d 


ib(x.y)  =  ^^CmrCXp 
ni  n 


C) 
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where  C— .  denotes  Fourier  coefficient;  m  and  n  are  integers; 
d  and  f  are  the  periods  of  the  grating  in  the  x  and  y  directions, 
respectively;  and  Ax  =  2'ird/3  is  the  width  of  a  color  pixel 
shown  in  Fig.  1(a). 

If  (h(x,  y)  is  a  slowly  varying  function  compared  with 
Sr(x,  y),  s,(x.  y),  and  Sb(x,  y).  then  6(x,y)  is  approximately 
uniform  and  can  be  neglected  in  the  analysis.  The  system  is 
then  a  space-invariant  processor.  In  fact,  for  the  LCTV  used, 
6(x,  y)  cannot  be  approximated  as  unity,  and  the  system 
suffers  from  space  variance.  For  simplicity,  Eq.  (1)  is  rewrit¬ 
ten  as 

s(x,y;X)  =  2  si(x,y)ii(x,y)  ,  (3) 

k=r,g.b 

where 

Skfx.y)  =  S|,(x.y)exp|i6(x,y)]  .  (4) 

Keep  in  mind  that  the  electronic  signal  modulates  both  the 
amplitude  and  phase  of  the  complex  amplitude  function  S|c(x,  y) 
but  does  not  alter  the  inherent  phase  function  <b(x,  y).  Since 
the  input  plane  is  illuminated  by  collimated  polychromatic 
coherent  plane  waves  of  red.  green,  and  blue  wavelengths, 
the  complex  light  distributions  at  the  back  focal  plane  of  the 
achromatic  transform  lens  are 


s(a.P;X)=  V  S;(Q,P)«Tk(o.P).  (5) 

k=r,g.b 

where  *  stands  for  the  convolution  operation,  Sfc(a,P)  is  a 
Fourier  transform  of  st(x,y).  and  the  Tk(a,3)  are 


T,(a.P)  =  V  2c„6(a  ^ M  . 

\  2ird  2iTf  / 

in  n 


exp  -1 


in  0 

(  .  2mAx  \ 


where  5(4,t|)  is  a  Dirac  delta  function  and  f  and  X  are  the 
achromatic  focal  length  and  wavelength,  respectively. 

If  the  color  filter  is  constructed  as  shown  in  Fig.  3(a).  color 
spectra  are  isolated  spatially  at  the  Fourier  transform  plane. 
Thus,  multiple  MSFs  can  be  synthesized  for  all  three  wave¬ 
lengths  with  a  sufficiently  expanded  collimated  polychro¬ 
matic  reference  beam. 

We  now  discuss  the  correlation  due  to  a  single  wavelength, 
using  as  an  example  the  red  light.  Since  in  the  synthesis  of 
MSFs  the  complex  light  field  at  the  red  section  on  the  Fourier 
plane  is 


.P)  =  exp^— p-j  -r  S;<Q.p)  *  Tr(a.p)  . 


where  N  is  the  number  of  spectra  (N  =  max{mn})  and  6  is  a 
small  reference  angle.  The  recorded  complex  MSFs  then  can 
be  written  as 


H,(a,P)=  jE,(a.P) 

=  isf[  =  I  J-l" 

.  V  2itd  2irl  I  N 

m  n  ‘ 


— »n  fX^m  fXfP 

—  s;  Q  i - .  p  =  — 

N  V  2iTd  2ti( 


fk,m  ^  fX,n  \  /  -iep  \1 

- S  *  a  ± - .  P  = -  exp  -  [  ,  (8) 

N  V  2ird  2-n(  /  \  X,  /  J 

where  the  superscript  •  denotes  the  complex  conjugate.  For 
simplicity,  we  have  ignored  the  proponional  constant.  If 
these  complex  MSFs  are  inserted  in  the  Fourier  transform 
plane  and  illuminated  by  the  object  beam,  the  field  immedi¬ 
ately  behind  the  MSFs  is 

u.(a.6)  • 

mo 

The  field  at  the  output  plane  is  the  inverse  Fourier  transform 
of  Eq.  (9),  which  consists  of  zero-order,  convolution,  and 
correlation  terms  corresponding  to  the  first,  second,  and  third 
terms  of  Eq.  (8).  Since  we  are  interested  only  in  correlation 
output,  we  Ignore  the  first  and  second  terms.  Therefore,  the 
red  correlation  output  can  be  expressed  as 

_  ,  f  /  fX,ni  fXrii  \ 


X  y  y  s;*  ( a  i p  * 

N  \  2Trd  2trl 

m  n 


where  FT“'{  }  represents  inverse  Fourier  transformation. 
Since  SJ(a  ±  (fXrm.'2‘ird),  p  i  (fXrn/2‘iTO)  are  not  overlapped 
for  different  (m,  n).  Eq.  (10)  becomes 
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By  taking  the  inverse  Fourier  transform,  we  have 
grix.y)  *  ■^)] 

®-^s*(x,y  -  ef)exp|i|^-^  +  Y(y-ef)j 


(12) 


where  ®  denotes  correlation.  From  this  equation,  we  see  that 
the  red  correlation  signal  of  the  sampled  input  is  diffracted  in 
the  neighborhood  of  (0,0f)  at  the  output  plane  of  the  poly¬ 
chromatic  coherent  processor.  It  is  not  difficult  to  see  that 
green  and  blue  correlation  signals  are  also  diffracted  in  the 
neighborhood  of  (0.6f).  In  other  words,  the  color  correlation 
signals  are  superimposed  to  form  the  actual  color  of  the  input. 

We  now  discuss  the  correlation  output  for  the  single 
matched  filtering  and  multiple  matched  filtering  techniques. 
For  simplicity,  the  tk(x,y),  where  k  =  r.g.b.  are  assumed  to 
be  normalized  comb  functions.  In  reference  to  Eq.  (2), 
denotes  the  Fourier  coefficient  of  the  sampling  functions; 
thus,  it  can  be  approximated  as  unity  (Cm„  =  1 )  in  the  follow¬ 
ing  analysis. 

4.1.  Single  matched  filtering 

If  only  one  order  of  the  spectra  of  each  color  is  used  for 
matched  filtering — for  example,  we  may  choose  (-1,0)  order 
for  red,  (0.1 )  order  for  green,  and  (1,0)  order  for  blue — then 
the  polychromatic  correlation  signal  would  be 

J_ 


(x,y)p  = 


X  ®  st(x.y-eol^ 

k=r,g,b 


(13) 


where  C_i,o  =  Co.i  =  C|.o  =  1  and  where  the  unimpor¬ 
tant  phase  factor  has  been  neglected.  Therefore,  a  perfect 
correlation  between  two  unsampled  color  patterns  can  be  ob¬ 
tained.  The  correlation  peak  height  is 

(PH),  = max]  T  |5k(x,y)  ®  sl(x,y-ef)p  [  ,  (14) 

^  k=r.g.b  J 

where  max  { }  denotes  the  operation  of  taking  a  maximum. 
4.2.  Multiple  matched  filtering 

The  pixel  structure  of  the  LCTV  diffracts  light  energy  into 
many  orders,  as  shown  in  Fig.  2.  That  makes  the  single 
matched  filtering  correlation  signal  expressed  in  Eq.  (13) 
difficult  to  detect  in  practice.  A  multiple  matched  filtering 
method  to  overcome  this  difficulty  was  proposed  conceptually 
in  Sec.  3.  The  red  correlation  is  expressed  in  Eq.  (12)  and  can 
be  further  written  as 


g,(x,y)  =  ^  |^s,(x,y)  ®  s*(x,y  -  0f) 

■^"'7 

1.  L  d  ( 


m  D 


(y  +  ef) 


(15) 


Assuming  that  all  diffracted  spectra  are  used  and  that  * 
Cm,  »  1,  Eq.  (15)  can  be  interpreted  as  an  approximation  of 
the  sampled  correlation  coutput  when  compared  with 
Eq.  (2).  This  equation  also  shows  that  the  final  correlation 
signal  gr(x,  y)  is  a  coherent  superposition  from  all  of  the 


individual  MSFs.  Each  MSF  contributes  an  individual  corre¬ 
lation  signal  common  in  amplitude  but  different  in  phase. 
Therefore,  the  final  correlation  signal  would  have  an  envelope 
function. 


|^s,(x,y)  ®  $»(x,y  -  ef)j  , 


(16) 


covering  subpeaks  resulting  from  the  constructive  interfer¬ 
ence  among  contributions  from  different  MSFs.  The  construc¬ 
tive  interference  occurs  when 
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mx  n 

y  ef) 
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J  . 

in  Eq.  (15)  is  equal  to  N.  The  main  correlation  peak  height  of 
the  multiple  matched  filtering  can  be  expressed  as 


(PH)m  =  maxj  ^  |Sk(x.y)  ®  sl(x,y-ef)|*  i  . 
k  =  r,g.b 

Substitution  ofEq.  (14)  into  Eq.  (17)  yields 
(PH)„  =  N==(PH)s  . 


(17) 


(18) 


where  (PH)m  and  (PH)s  are  the  correlation  peak  heights  of 
multiple  and  single  matched  filterings,  respectively.  The  im- 
portant  features  of  the  multiple  matched  filtering  method  are 
(1)  the  main  correlation  peak  height  is  increased;  (2)  the  width 
of  the  envelope  is  the  same  as  for  the  single  matched  filtering 
correlation  signal;  and  (3)  subpeaks  arc  created,  which  prob¬ 
ably  raise  false  alarms.  Although  subpeaks  are  covered  by  the 
envelope  function  in  expression  (16).  they  arc  separated,  as 
illustrated  schematically  in  Fig.  4.  An  example  of  experi¬ 
mental  observation  is  also  shown  in  Fig.  9(a).  A  proper  elec¬ 
tronic  postprocessing  system  can  be  introduced  to  eliminate 
false  alarms.  An  image  digitizer  can  be  applied  to  detect  the 
correlation  signal,  where  a  threshold  is  set  to  hard  clip  the 
signal  and  to  select  only  one  main  correlation  peak  for  a 
correlated  pattern. 

5.  EXPERIMENTS 

Experiments  were  conducted  using  the  optical  setup  shown 
schematically  in  Fig.  6.  A  disassembled  color  LCTV  (Radio 
Shack  catalog  No.  16-154)  was  applied  as  a  real-time  input 
screen.  To  eliminate  the  variation  introduced  by  the  surfaces 
of  the  cover  glasses, the  LCTV'  was  immersed  in  a  liquid  gate 
filled  with  mineral  oil.  The  poor-quality  plastic  polarizers  on 
the  LCTV  were  replaced  by  two  higher-quality  polarizers  in 
front  of  and  behind  the  liquid  gate.  HeNe  laser  generated  red 
coherent  light  was  combined  with  Ar  laser  generated  green 
coherent  light  by  a  beam  splitter  as  the  polychromatic  coher¬ 
ent  light  source. 

The  LCTV  is  equipped  with  a  video  input  jack,  which 
allows  an  image  to  be  written  electronically  with  a  microcom¬ 
puter  or  optically  with  a  TV  camera.  An  Apple  HE  microcom¬ 
puter  was  used  to  write  a  color  input  pattern  with  the  low- 
resolution  mode.  Figures  7(a)  and  7(b)  show  black-and-white 
pictures  of  a  color  pattern  generated  on  a  TV'  monitor  and  on 
the  LCTV,  respectively,  where  a  red  letter  P  was  superim¬ 
posed  on  a  green  letter  S  and  the  overlapping  areas  were 
yellow  to  simulate  a  multicolored  object.  The  multiple  MSFs 
were  synthesized  using  the  setup  shown  in  Fig.  6.  The  Fourier 
transform  plane  was  covered  with  color  filters  arranged  as 
shown  in  Fig.  3(c),  i.e..  the  green  MSFs  were  in  the  upper 
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.  Black>«nd-whhe  pacturat  of  color  panam  ganaratad  on  (al  TV  monitor  and  (bl  LCTV  diaptay.  (A  rad  letter  P  was  supertmpoaed  on  a  green 
S.  with  yellow  ovartapping  area*  to  aimulata  a  color  objecL) 


8.  Successively,  a  red  letter  S  and  a  dark  screen  were  tested. 
The  experimental  results  arc  presented  in  Fig.  9.  Figures  9(a). 
9(b).  and  9(c)  arc  the  correlations  obtained  without  hard  clip¬ 
ping  w'hen  the  tested  input  was  a  red  P.  a  red  S.  and  a  dark 
screen.  Figures  9(d).  9(e)  and  9(f)  are  the  correlation  peaks 
after  a  photographically  hard-clipping  process.  The  autocor¬ 
relation  of  the  color  pattern  shown  in  Fig.  7(b)  is  presented  in 
Fig.  10.  In  this  figure,  a  black-and-white  picture  of  the  yellow 
color  correlation  signal  (i.e.,  the  superposition  of  red  and 
green)  is  presented.  Similarly,  a  hard-clipping  technique 
could  also  be  used  to  obtain  a  cleaner  correlation  peak. 

6.  DISCUSSION  AND  CONCLUSION 

A  color  LCTV  is  suitable  for  polychromatic  coherent  process¬ 
ing  since  the  display  panel  is  composed  of  three  primary  color 
pixels.  We  have  shown  that  a  color  LCT\'  can  be  used  for 
color  pattern  recognition.  The  grid  structure  of  the  display 
panel  together  with  a  specially  designed  color  filter  provides 
spatially  isolated  polychromatic  spectra  to  enable  polychro¬ 
matic  signal  detection. 

A  serious  drawback  of  the  color  LCTV  is  the  lack  of  space 
invariance,  even  after  it  has  been  immersed  in  a  liquid  gate. 
This  drawback  may  be  partially  due  to  the  inherent  color  filter 
in  the  liquid  crystal  display  and  the  phase  modulation  by 
liquid  crystal  molecules.  A  quantitative  investigation  of  space 
variance  of  the  LCTV,  especially  the  color  LCTV.  is  cur¬ 
rently  under  intensive  study  and  will  be  reported  in  the  near 
future. 

We  have  proposed  a  multiple  matched  filtering  technique  to 
improve  the  correlation  signal.  However,  in  practice  the  dif¬ 
fraction  efficiencies  vary  for  different  MSFs.  and  thus  Eq. 
( 18)  IS  not  valid.  The  Homer  efficiency  in  a  multiple  matched 
filtenng  correlated  output  was  observed  to  be  approximately 
30  (-"N)  times  higher  than  the  single  matched  filtenng  corre¬ 
lation  using  a  color  LCTV.  With  the  aid  of  a  hard-clipping 


Rg.  8.  SynthMixad  MSFs  of  the  object  in  Fig.  7(b).  Upper  part  was 
used  for  green  light  and  lower  part  for  rod  light.  (There  were  actualiy 
10  spectra  in  the  vertical  line  and  20  spectra  in  the  horizontal  line  for 
each  section.  Distance  between  two  adjacent  spectra  in  the  red 
section  it  about  0.7  mm.) 


part  and  the  red  MSFs  were  in  the  lower  part.  To  achieve  the 
optimum  performance  of  the  MSFs.  the  red  and  green  por¬ 
tions  of  the  filters  were  exposed  under  different  exposures  due 
to  the  spectral  characteristics  of  the  photographic  plate.  How¬ 
ever,  the  exposed  MSFs  were  developed  in  a  single  process. 
Figure  8  is  a  photograph  of  the  synthesized  MSFs  of  the  color 
pattern  shown  in  Fig.  7(b). 

To  verify  the  proposed  method,  two  experimental  results 
are  demonstrated.  Figure  9  shows  the  results  using  a  single 
laser  to  illustrate  the  method  of  multiple  matched  filtering. 
Figure  10  shows  the  result  using  two  lasers  to  illustrate  bi- 
chromatic  correlation.  First,  using  a  HeNe  laser,  a  red  letter  P 
was  used  as  an  input  to  correlate  with  the  MSFs  shown  in  Fig. 
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R  fig.  9.  Corralatiom  without  hard  dipping  of  (a)  rad  lattar  P  and  rad  lettar  P,  (b)  rad  lettar  P  and  rad  lattar  S,  and  Ic)  rad  lettar  P  and  dark  acraan 
K  [distanca  batwaan  two  adiacant  points  in  (al,  (b|.  and  id  is  about  340  pm],  (d)  Enlargad  hard-dipping  rasult  of  la);  (a)  hard-dipping  rasuh  of  lb); 


and  If)  hard-dipping  rasult  of  le). 


Fig.  10.  Biack-and-whita  pictura  of  autocorralation  without  hard  dip¬ 
ping  of  Rg.  71b),  whara  MSFs  shown  in  Fig.  8  wara  usad.  (Distanca 
batwaan  two  adjacant  points  is  about  340  pm.) 


technique,  the  multiple  matched  filtering  correlated  output 
presents  a  higher  signal -to-noise  ratio  while  the  false  alarm  is 
simultaneously  depressed.  We  also  have  demonstrated  poly¬ 
chromatic  signal  detection  using  the  color  LCTV.  By  imple¬ 
menting  a  hard-clipping  postprocessing  system,  a  full}  real¬ 
time  color  pattern  recognition  system  can  be  constructed. 

W'e  would  like  to  stress  that  the  color  LCTV  is  a  low-cost 
spatial  light  modulator  capable  of  processing  polychromatic 


signals.  W'ith  further  improvements  the  color  LCTV  should 
be  useful  for  color-sensitive  robotic  vision  and  other  auto¬ 
matic  color  pattern  recognition  as  applied  to  real-time  recon¬ 
naissance.  guidance,  and  surveillance. 
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Symbolic  substitution  was  first  proposed  by  Huang'  as  a 
means  of  utilizing  the  parallelism  of  optics  to  perform  digital 
computing.  In  this  method,  specific  logic  patterns  are  sub¬ 
stituted  into  new  logic  patterns  in  parallel  according  to  a 
given  transformation  rule.  The  operation  and  possible  im¬ 
plementation  of  the  symbolic  substitution  are  recently  re¬ 
ported  by  Brenner  et  air  and  Brenner.^  It  has  been  demon¬ 
strated  that  symbolic  substitution  can  be  applied  to  Boolean 
logic,  binary  arithmetic,  Turing  machine,  artificial  intelli¬ 
gence,  etc.'-^ 

Unlike  the  Boolean  logic,  symbolic  substitution  recognizes 
not  only  a  combination  of  bits  but  also  the  relative  location  of 
these  bits.  The  output  is  not  just  a  single  bit  but  rather  a 
combination  of  bits  positioned  in  a  particular  manner.  The 
schematic  diagram  of  symbolic  substitution  is  depicted  in 
Fig.  1(a).  The  transformation  of  specific  logic  pattern  in  the 
process  of  symbolic  substitution  is  carried  out  by  a  series  of 
operations:  split-shift-combine-NOR-mask-split-shift- 
combine-mask. 

Symbolic  sutstitution  is  essentially  a  combination  of  rec¬ 
ognition  and  substitution  phase.  In  addition,  although  sym¬ 
bolic  substitution  is  not  restricted  to  space  invariant  opera¬ 
tions.  it  is  indeed  based  on  the  space  invariant  connectivity  of 
optics.  Therefore,  a  method  of  optical  associative  memo¬ 
ries'*  may  be  alternatively  applied  to  implement  a  symbolic 
substitution  logic  system.  In  the  method  of  optical  associa¬ 
tive  memories,  logical  1  and  logical  0  are  encoded  in  certain 
spatial  patterns  instead  of  bright  and  dark^  or  polarization 
direction.^  For  example,  the  logic  patterns  shown  in  Fig. 
1(a)  may  be  encoded  into  the  patterns  shown  in  Fig.  Kb), 
where  logical  1  and  logical  0  are  encoded  into  a  cross  and  a 
ring,  respectively.  This  has  the  advantage  of  distinguishing 
logical  0  and  a  void  space  having  no  information. 

A  method  is  first  proposed  using  a  matched  spatial  filter 
(MSF)  to  recognize  input  patterns.  The  autocorrelation 
spots  (assumed  to  be  delta  functions)  are  convoluted  with  a 
desired  output  pattern  so  that  each  correlated  input  pattern 
produces  an  output  pattern.  The  proposed  optical  setup  is 
schematically  depicted  in  Fig.  2.  The  MSFl  and  MSF2  are 
Fourier  transform  holograms  of  input  and  output  patterns, 
respectively.  The  drawback  of  this  method  may  be  the  low 
diffraction  efficiency,  although  a  phase-only  hologram  may 
be  used.  In  general,  cross-correlation  noise  appears.  To 
depress  the  output  pattern  come  from  cross-correlation. 
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Fig.  1.  Schematic  diagram  of  symbolic  substitution:  (a)  An  input 
logic  pattern  is  substituted  into  another  logic  pattern,  (b)  Logical  1 
and  logical  0  are  encoded  into  a  cross  and  ring,  respectively. 
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Fig.  2.  Optica]  setup  using  two  matched  spatial  filters  to  implement 
symbolic  substitution  logic. 


however,  a  thresholding  process  may  be  applied  at  the  corre¬ 
lation  or  output  plane. 

The  second  proposed  method  is  making  use  of  a  specially 
designed  computer-generated  hologram  (CGH).  By  using  a 
computer-generated  hologram,  an  input  image  is  converted 
into  another  associative  image.  If  the  input  pattern  is  de¬ 
noted  by  a  function  (u,y ).  and  the  associative  output  pattern 
is  o(zo')'  fbe  mathematical  relation  can  be  expressed  as 

/(u,i')P(uj;)  “  0(uj;),  (1) 

where  Plu.p)  stands  for  the  filter  function.  I(u,v)  and  Oiu.u) 
are  Fourier  transforms  of  ilx.y)  and  o(x,y),  respectively. 

A  carrier  frequency  may  be  added  to  encode  the  complex 
value  of  Piu.L't  and  give  diffracted  output.  This  technique  is 
possible  to  implement  optically.  A  more  sophisticated  two- 
way  code  translation  has  been  demonstrated  by  Lohmann 
and  Thum.^  In  two-way  code  translation,  a  holographic 
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Fig.  3.  Optical  setup  using  compuur-generated  holographic  asso¬ 
ciative  memories  to  implement  symbolic  substitution  logic. 


Fig.  4  Example  of  information  unit  cell  with  4  bits. 


niter  converts  one  specific  image  into  a  second  associative 
image,  and  it  can  also  convert  the  second  image  into  the  first 
image.  Mathematically,  the  filter  function  must  satisfy  si¬ 
multaneously  Eq.  (1)  and  the  following  Eq.  (2): 


0(ujj)P‘{um)  “  Hu^). 


(2) 


For  the  implementation  of  symbolic  substitution,  only  a 
filter  function  satisfying  Eq.  (1 )  is  required.  Thus  ilis  easier 
to  realize  rather  than  that  of  Lohmann  and  Thum.‘  In  the 
computation  of  filter  function  P{u,v),  an  approximation 
might  be  taken,  because  there  will  be  no  analytic  solution  for 
Piu’.v')  when /(u', o')  is  zero  but  O(u'.v')  is  not  zero.  To  avoid 
this  difficulty,  an  alternative  method  of  optically  made  asso¬ 
ciative  hologram'*  may  be  applied.  The  proposed  optical 
setup  of  this  second  method  is  schematically  depicted  in  Fig. 
3.  In  the  above  described  methods,  each  information  unit 
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cell  must  have  a  boundary  to  distinguish  from  neighboring 
cells  as  illustrated  in  Fig.  4. 

On  the  basis  of  the  configuration  shown  in  Fig.  3,  the  use  of 
a  muliplezed  hologram  can  realize  the  operation  of  multiple 
instruction  multiple  data  (MIMD),  which  has  been  a  major 
problem  in  optical  computing.  In  reference  to  the  recent 
analysis  of  Hong  and  Psaltis.*  to  obtain  a  recognizable  output 
pattern  (SNR  2  1),  the  storage  capacity  of  a  multiplexed 
holographic  associative  memory  is  limited  by 


M  <  (SBP)h/(SBP)p. 


(3) 


where  M  is  the  number  of  associations,  (SBP)h  and  (SBP)/> 
are  the  SBP  of  the  hologram  and  an  information  unit,  respec¬ 
tively.  For  a  numerical  example,  if  an  information  unit  is 
encoded  in  thirty-six  pixels  as  shown  in  Fig.  4  and  a  comput¬ 
er-controlled  photoprinter  with  a  moderate  resolution  of  10 
X  10  um  is  used  to  print  the  SGH,  an  area  of  1  X  1  cm  of  the 
CGH  can  store  277  associative  memories. 

In  conclusion,  the  merits  of  the  proposed  implementation 
are  that  it  can  ( 1 )  handle  very  large  SBP  data.  (2)  perform 
any  substitution  in  one  simple  step,  and  (3)  perform  MIMD 
operation  using  a  multiplexed  hologram.  The  price  is  the 
use  of  more  than  1  pixel  (e.g.,  9  pixels)  to  encode  a  bit.  A 
thresholding  process  may  be  required  before  the  data  are 
transferred  to  the  next  operation. 

We  acknowledge  the  support  of  the  U.S.  Air  Force  Office  of 
Scientific  Research  grant  AFOSR-86-0264. 
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Abstract 


An  experimental  procedure  using  one-step  holographic  associative 
memories  to  implement  symbolic  substitution  is  described.  The  linearity 
of  multiple  holographic  filtering  is  abolished  in  practice.  Experimental 
results  of  parallel  half-addition  are  presented.  It  is  seen  that  parallel 
half-addition  is  an  example  of  multiple-instruction-multiple-data  (MIMD) 
operation. 


Subject  terms:  optical  computing,  symbolic  substitution,  associative 
memories,  multiple-instruction-multiple-data 


I.  Introduction 


Recently,  ve  proposed  two  methods  to  optically  implement  symbolic 
substitution  logic  using  holographic  associative  memories  [1].  Symbolic 
substitution  was  originally  proposed  by  Huang  (2]  as  a  means  of  utilizing 
the  paralellism  of  optics  to  perform  digital  computing.  Some  possible 
implementations  of  symbolic  substitution  have  been  demonstrated  by 
Brenner  et  al.  [3],  Brenner  [4],  Tsao  et  al.  [5],  and  Casasent  and  Botha  [6]. 
In  our  recent  Letter  [1],  ve  proposed  the  implementation  of  symbolic 
substitution  based  on:  (1)  two  step  Vender  Lugt  filter,  which  is  also 
applied  by  Paek  and  Psaltis  [7],  and  pointed  out  by  Casasent  and  Botha  [6], 
and  (2)  one  step  holographic  associative  memories  [8],  which  is  also 
described  in  Ref.  [7].  In  this  paper,  we  shall  demonstrate  the  experimental 
verification  of  symbolic  substitution  using  only  one  step  holographic 
associative  memories. 

II.  Background 

Unlike  the  Boolean  logic,  symbolic  substitution  recognizes  not  only 
a  combination  of  bits  but  also  the  relative  location  of  these  bits  [2). 

The  output  is  not  just  a  single  bit  but  rather  a  combination  of  bits 
positioned  in  a  particular  manner.  The  schematic  diagram  of  symbolic 
substitution  logic  is  depicted  in  Fig.  1(a).  Symbolic  substitution  is 
essentially  a  combination  of  recognition  and  substitution  phase.  Therefore, 
optical  associative  memories  may  be  applied  to  construct  a  symbolic 
substitution  logic  system.  In  this  system  logical  1  and  logical  0  are 
encoded  in  certain  spatial  patterns.  For  example,  the  logic  patterns  shown 
in  Fig.  1(a)  may  be  encoded  into  the  patterns  shown  in  Fig.  1(b).  This  has 
the  advantage  of  distinguishing  logical  0  and  a  void  space  having  no 


information. 


The  basic  experiaental  setup  is  depicted  in  Fig.  2.  A  joint  Fourier 
transforn  hologram  of  an  input  and  an  output  pattern  is  .first  recorded  as 


shown  in  Fig.  2(a).  The  output  pattern  will  be  generated  optically  by 
illuminating  the  hologram  with  the  input  pattern  in  the  same  optical  setup 
as  shown  in  Fig.  2(b).  To  perform  a  Boolean  operation,  for  instance,  AND 
function,  four  associative  memories  are  required,  which  correspond  to  four 
possible  combinations  of  two  inputs.  This  technique  differs  from  the 
truth-table  look-up  optical  processor  [9,10]  which  basically  applies 
interferometric  subtraction  technique. 

III.  BCB's  Contradiction  of  Linearity 

Botha,  Casasent,  and  Barnard  (BCB)  pointed  out  that  a  contradiction 
would  be  present  if  a  linear  holographic  filter  was  used  to  perform  nonlinear 
logic  operations  (11).  To  show  this,  the  symbolic  substitution  for  the  AND 
function  is  considered.  Denoting  the  four  possible  inputs  as  I, (0,0), 
12(0,1),  1^(1, 0),  and  1^(1,!),  the  four  AND  outputs  are  0^  «  0-^«  0^  •  0 
and  0^  «  1.  In  symbolic  substitution,  specific  spatial  patterns  are  used 
to  represent  each  argument  in  the  inputs  to  and  in  the  output. 
Considering  the  holographic  filtering  as  a  linear  system,  it  is  seen  that 


^3  - 


tnc  the  corresponding  output  must  be 


vhich  is  contradictory  to  the  logic  output 


0  „  -  1 
r 


0  overcome  this  problem,  the  linearity  of  the  multiple  holographic 


filtering  must  be  abolished.  Ve  actually  conducted  the  experiment  in 
the  same  spirit  as  that  of  Refs  [6],  [7]  and  [10],  or  the  first  method 
described  in  our  previous  Letter  [1],  that  is  a  process  of  independent  mult 
channel  correlations.  In  reality,  a  multi-holographic  filtering  is  not  an 
ideal  linear  system.  In  the  example  discussed  above,  four  independent 
holographic  associative  memories  are  required,  i.e.,  holographic  filters 
to  associate  outputs  0  ,  ,  0  ,  0^  ,  and  0^  with  inputs  I  ^  ,  I2  ,  I3  ,  and 

I^  ,  respectively.  Using  a  nonlinear  thresholding  device  in  the  output 
plane  and  varying  each  filter  bandwidth  in  the  hologram  synthesis,  it  can 
be  expected  that 

0.  >  O3  -  0,  0  ,  (4) 

while  individual  outputs  may  still  be  approximated  as  . 

0,^0 


0^-1  .  (5) 

Note  that  0  and  1  represent  specific  spatial  patterns  rather  than  numbers. 
Ve  will  be  back  to  this  discussion  in  the  next  section. 

IV.  Experiments 

Ve  used  photographic  film  as  input  transparency  in  the  experiment. 
Nine  pixels  were  required  to  encode  one  bit  as  depicted  in  Fig.  1(b). 

The  patterns  representing  1  and  0  cannot  be  orthogonal,  since  the 
orthogonality  will  eliminate  the  association  of  two  patterns.  In  other 
words,  the  two  patterns  must  have  overlapping  spectra  in  the  Fourier  plane 
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in  order  to  obtain  good  holographic  image.  Ve  have  implemented 
■I  half-adder,  in  which  sum  (XOR  function)  and  carry  (AND  function)  were 
performed  simultaneously  from  the  same  data.  This  is  an  example  of  the 
realization  of  multiple-instruction-multiple-data  (MIMD)' architecture 
utilizing  the  parallelism  of  optics.  Pour  combinations  of  input  and  the 
corresponding  output  combinations  of  sum  and  carry  are  illustrated  in 
Pig.  3.  To  implement  four  associative  memories  in  a  single  hologram, 
the  spatial  modulation  technique  [12]  was  applied.  An  additional  cross 
Ronchi  grating  was  superimposed  with  the  input  pattern  to  give  multiple 
carrier  frequencies  as  shown  schematically  in  Pig.  4(a). 

In  the  synthesis  of  holographic  filters,  a  mask  was  employed  in  the 
Pourier  plane  such  that  each  input  combination  occupies  only  one  quadrant 
of  the  Pourier  plane  as  depicted  in  Pig.  4(b).  This  multiple  spectra 
configuration  would  enhance  the  dynamic  range  of  holographic  filter  as 
pointed  out  elsewhere  [13].  It  is  more  important  to  notice  that  this  multiple 
spectra  configuration  approaches  the  conditions  expressed  in  Eqs.  (4)  and  (5), 
since  it  is  very  common  to  obtain  slightly  different  bandwidth  for  different 
associative  memories.  In  the  final  stage,  a  video  monitor  system  was  applied 
in  the  system  to  detect  and  threshold  the  hologram-generated  output. 

A  set  of  experimental  result  is  illustrated  in  Pig.  5.  The  direct 
associations  shown  in  Pig.  5  were  obtained  using  only  one  uncovered  quadrant 
of  the  hologram  for  each  association.  To  perform  parallel  half-addition,  the 
whole  hologram  was  uncovered.  An  example  of  parallel  half-addition,  i.e., 
sum  and  carry  are  obtained  in  parallel,  is  demonstrated  in  Pig.  6.  This 
picture  was  also  taken  from  the  video  monitor  after  thresholding.  Although 
cross  correlation  still  exists,  the  dominant  output  is  the  correct  logic 
pattern.  It  is  seen  that  the  BCB's  contradiction  of  linearity  may  be 
overcome  in  practice.  Por  comparison,  Pig.  7  shows  the  output  when  four  input 
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combinations  are  associated  vith  only  one  memory  (only  one  quadrant  of  the 
hologram).  The  input  associated  vith  the  filter  produced  the  dominant  output 
pattern. 

The  absence  of  the  BCE's  contradiction  of  linearity  can  be  explained 
in  the  following  discussion.  In  the  case  that  the  input  is  ,  a 
quarter  of  the  input  energy  (assume  1/4  E)  will  be  incident  on  the  quadrant 
associated  with  The  output  0^  will  have  a  total  intensity  of  1/4 oC  E, 

where  ot  is  the  energy  diffraction  efficiency  of  the  hologram.  A  quarter  of 
the  input  energy  (1/4  E)  will  also  be  incident  on  the  quadrant  associated 
vith  1 2  •  Since  +  ,  the  output  from  this  quadrant  is 

0^^  plus  the  noise  come  from  the  crosstalks  between  I^and  ,  and  I  ,  and 
1 2  •  This  leads  to  the  fact  that  the  output  pattern  O^vill  have  a  total 
intensity  lover  than  l/4oi  E.  The  other  two  quadrants  follow  the  same 
analysis.  Ue  may  conclude  that  the  output  pattern  O^.  +  0^  -  0, 
generated  from  three  quadrants  always  have  lower  intensity  than  that  of 
the  output  pattern  directly  generated  from  the  quadrant  associated  vith 
I  .  Thus  a  thresholding  process  can  be  applied  to  hardclip  the  total 
output  pattern  and  result  in  a  clean  pattern  0^^  . 

V.  Conclusion 

We  have  demonstrated  an  experimental  procedure  to  implement  symbolic 
substitution  logic  using  one  step  holographic  associative  memories.  To 
alleviate  the  BCB's  contradiction  in  practice,  a  spatial  modulation  technique 
was  applied.  The  spatial  modulation  technique  also  gives  more  flexibility  in 
the  filter  synthesis  compared  vith  the  multiplexing  technique,  since  the 
hologram  has  a  limited  dynamic  range.  An  example  of  MIMD  operation,  i.e., 
parallel  half-addition  has  been  shown.  Utilizing  real-time  spatial  light 
modulators  such  as  LCLV,  LCTV,  MOSLM,  etc,  a  full-addition  may  be  realized 


by  Bulti-step  substitution  [2],  If  the  cross  correlation  can  be  totally 
eliminated,  the  proposed  one  step  technique  may  be  superior  to  the  pinhole 
sampling  technique  [7],  since  the  one  step  holographic  technique  is  fully 
space  invariant. 
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Figure 
Fig.  1 

Fig.  2 


Fig.  3 
Fig.  4 

Fig.  5 
Fig.  6 
Fig.  7 


Captions 

(a)  Schematic  diagram  of  symbolic  substitution  logic. 

(b)  Logical  1  and  logical  0  are  encoded  into  certain  spatial 
patterns. 

(a)  Recording  of  joint  Fourier  transform  hologram  of  an  input  and 
an  output  pattern,  (b)  Reconstruction  of  output  from  an  associated 
input  pattern.  Input  pattern  is  also  observed  in  the  output  plane 
due  to  the  dc  term  of  hologram. 

Combinations  of  inputs  and  the  resulted  carry  and  sum. 

(a)  Input  pattern  is  superimposed  with  cross  P.onchi  grating  in  spatial 
modulation  technique,  (b)  Hologram  indicates  that  multiple  spectra 
occupy  four  quadrants  of  Fourier  plane. 

Experimental  results  shoving  direct  associations. 

Experimental  result  of  1+1  half-addition. 

Experimental  result  shoving  the  associations  between  four  inputs  with 
a  filter  of  0+0.  Only  one  dominant  output  pattern  was  observed  as 
it  was  expected  (carry^O,  sum=0). 
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The  implementation  of  sixteen  optical  parallel  boolean  logic  gates  using  two  magnetooptic  spatial  light  modulators  are  described. 
The  expenmental  results  are  also  presented 


1.  Introduction  is  altered  due  to  the  Faraday  effect  in  the  MOSLM. 

Currently  available  MOSLMs  have  48x48  or 
Optical  and  electro-optical  switches  have  been  1 28  x  128  randomly  accessible  pixels.  The  pattern  on 
extensively  studied  for  applications  such  as  optical  MOSLM  can  be  generated  by  a  microcomputer 

computing,  opto-digital  circuit,  and  optical  com-  of  ^  CCD  camera.  When  the  magnetization  of  a 

munication  networks.  Complementary  to  the  rapidly  P'Wl  is  in  the  positive  direction,  the  polarization  of 

emerging  photonic  devices  [  1 ),  many  optical  par-  the  incident  light  will  be  rotated  by  an  angle  a,  and 
allel  logic  gates  have  been  successfully  implemented  the  polarization  will  be  rotated  by  -a  for  negative 

using  current  technology.  The  optical  parallel  logic  magnetization.  These  two  states  are  the  stable  states 

operations  have  been  performed  using  PROM  of  the  device.  Ideally,  a  =  45%  and  using  an  analyzer 

devices  [2,3],  twisted  nematic  liquid  crystal  devices  'vith  a  45'  orientation,  a  high  contrast  output  would 

[4],  liquid  crystal  light  valves  [5],  shadowgrams  (6],  he  obtained.  Currently  available  devices,  however, 

and  spatial  filtenng  technique  [7],  Recently  we  have  ai'c  only  capable  of  a  few  degrees  of  polarization 

demonstrated  a  new  implementation  of  optical  par-  rotation, 

allel  logic  gates  using  two  cascaded  inexpensive  com¬ 
mercially  available  liquid  crystal  televisions  [8]. 

Khan  and  Nejib  [9]  presented  a  theoretical  descrip-  3,  Theon’ 
tion  of  optical  logic  gates  employing  liquid  crystal 

switches.  Optical  parallel  logic  gates  can  also  be  boolean  algebra,  there  are  sixteen  logic  func- 

impiemented  using  magneto-optic  spatial  light  mod-  jjjpmj  and  B.  Table  1  shows  in  reg¬ 
ulators  ( MOSLMs )  in  a  similar  manner  as  that  pro-  p^^^jj^le  functions  for  positive 

posed  by  Khan  and  Nejib.  This  paper  demonstrates  For  simplicitv,  onlv  the  case  of  positive  logic 

the  implementation  of  optical  parallel  logic  based  on  ,5  discussed  in  this  paper'.  The  analysis  can  be  mod- 
MOSLM.  straightforwardly  for  the  case  of  negative  logic. 

Fig.  1  shows  the  multiplicative  configuration  to 
perform  FI.  F2.  F4,  F6.  F8  and  F9.  Two  MOSLMs 

2.  Magneto-optic  spatial  light  modulator  are  arranged  in  tandem.  The  three  polanzers  arc 

placed,  resp..  in  front  of  MOSLM  1.  between  the  two 
The  MOSLM  is  a  transmission-type  electro-optic  MOSLMs  and  behind  MOSLM2.  .A  collimated  beam 
spatial  light  modulator  [  lO],  When  polanzed  light  is  required  to  preserve  a  one-to-one  ptxel  relation- 

passes  through  the  MOSLM,  its  plane  of  polarization  ship.  Recalling  that  the  Faraday  rotation  effect  is 
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Table  I 

Sixteen  possible  functions  of  two  binary  variables  for  positive  logic 


Inpui 

Output 

A  B 

FO 

FI 

F2 

u. 

F4 

F5 

F6 

F7 

F8 

F9 

FIO 

Fll 

Fi: 

F13 

F14  F15 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

1 

1 

1 

1 

1 

1  1 

0  1 

0 

0 

0 

0 

1 

1 

1 

1 

0 

0 

0 

0 

I 

1 

1  1 

1  0 

0 

0 

1 

1 

0 

0 

1 

1 

0 

0 

1 

1 

0 

0 

1  1 

1  I 

0 

1 

0 

1 

0 

1 

0 

1 

0 

1 

0 

1 

0 

1 

0  1 

Function 

name 

0 

AND 

aB 

A 

AB 

B 

XOR 

OR 

NOR 

XNOR 

B 

a*B 

A 

A-i-B 

NAND  1 

PI  MOSLMI  P2  MOSLM2 


P3 


Fig.  I.  Multiplicative  configuration  of  optical  parallel  logic  gales. 
PI.  P3.  P3:  polaniers. 


independent  of  the  sense  in  which  the  beam  trav¬ 
erses  the  magnetic  field  lines,  logic  operations  can  be 
performed  by  setting  polarizes  P2  and  P3  at  certain 
orientations.  To  perform  XOR  (  =  F6)  polarizer  P2 
is  removed.  It  is  noticed  that  XNOR  can  be  only  per¬ 
formed  using  this  configuration  if  a  %  45"  [8]. 

To  perform  F7,  Fll,  F13  and  F14,  an  additive 
configuration  shown  in  fig.  2  is  applied.  The  two 

Pi  BS  MOSLMI  P2  M 


Outpul 


M  M0SLM2  P3  BS 

Fig.  2.  Additive  configuration  of  optical  parallel  logic  gales.  M: 
mirror  BS.  beam  splitter.  PI.  P2.  P3:  polanzers. 
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MOSLMs  are  arranged  in  parallel.  The  polarizers  P2 
and  P3  are  placed  behind  MOSLM 1  and  MOSLM2, 
respectively.  The  images  of  two  MOSLMs  are  incoh¬ 
erently  supenmposed  by  means  of  a  beam  splitter. 
Because  o  is  actually  small  (^9°),  function  1 
(=F15)  and  function  0  (=F0)  can  be  approxi¬ 
mated  by  setting  the  analyzer  at  the  orientations  of 
0"  and  90',  respectively.  Therefore  FO.  F3.  F5.  FIO, 
F12  and  FI  5  can  be  performed  using  the  configu¬ 
ration  shown  either  in  fig.  1  or  fig.  2. 


4.  Experiment 

A  polarization  rotation  of  a  s  9'  has  been  observed 
in  the  experiment.  Malus  law  states  that  the  intensity 
of  the  transmitted  light  through  a  polarizer  placed  at 
an  angle  with  the  analyzer  varies  as  the  square  of  the 
cosine  of  the  angle.  If  the  maximum  transmittance 
after  the  analyzer  is  denoted  by  T  and  the  bias 
denoted  by  B.  the  intensity  ratio  of  the  bright  ( log¬ 
ical  1 )  and  dark  (logical  0)  ponions  will  be 

r-B  T-B 


^''7'cosM8=-r5“0.9ir-B' 
when  the  analyzer  is  onented  at  9 ' ,  and 
rsinM8'-fi  o.ir-5 


B 


B 


(1) 


(2) 


when  the  analyzer  is  oriented  at  (  -  9  90 ) '  =  8 1  ° . 
Note  that  eq.  (1)  gives  logical  1  the  highest  possible 
transmittance.  On  the  other  hand.  eq.  (2)  gives  to 
logical  0  the  lowest  possible  transmittance. 

The  combinations  of  polarizers  to  perform  all  the 
sixteen  logic  operations  are  summanzed  in  table  2. 


•  J 


y-c'. 


V*  "V*  "j* 


^7 
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Table  2 

Combinations  of  polanzers  to  implement  logic  gates  (a  =  9° ) 


Function 

Conriguration 

PI 

P2 

P3 

Comment 

FO 

Fig.  1 

0* 

90* 

0“ 

FI 

fig.  1 

0* 

81* 

162“ 

F2 

fig.  1 

0* 

-81“ 

0“ 

F3 

Tig  1 

0* 

81* 

81“ 

F4 

Fig  1 

0* 

81* 

0“ 

F3 

Fig  1 

0- 

0" 

81“ 

F6 

Fig.  1 

0* 

no  polanzer 

0“ 

n 

Fig  2 

0* 

81* 

81“ 

F8 

Fig.  1 

0“ 

-81* 

-162“ 

F9 

Fig  1 

0* 

no  polanzer 

18“ 

shown  in  Fig.  4  ( a ) 

-18“ 

shown  in  Fig.  4(b) 

FIO 

Fig.  1 

0* 

0* 

-81“ 

FI  1 

Fig.  2 

0” 

81* 

-81“ 

F12 

Fig.  1 

0= 

-81" 

81“ 

F13 

Fig  2 

0‘ 

-81“ 

81“ 

F14 

Fig.  2 

0" 

-81“ 

-81“ 

FIS 

Fig.  1 

0" 

0“ 

0“ 

Table  2  is  applied  to  the  case  of  lowest  possible  log¬ 
ical  0,  i.e..  eq.  (2).  The  experimental  results  are 
shown  in  fig.  3.  An  intermediate  level  is  produced 
due  to  the  bias  term  of  the  low  contrast  binar>’  pat¬ 
terns.  The  transmittance  of  the  activated  MOSLM 
consists  of  a  and  b.  where  a>b>0.  The  product  of 
two  patterns  will  include  three  transmittances.  i.e., 
a',  ab.  b'.  where  a->ab>b->0.  To  eliminate  the 
intermediate  level  ab  in  FI,  F2,  F4  and  F8.  a  hard- 
clipping  may  be  conducted  such  that  abs:b-.  The 
addition  of  two  patterns  will  also  result  in  three  lev¬ 
els.  i.e..  2a.  a-b.  2b.  where  2a>a  +  b>2b>0.  To 
eliminate  the  intermediate  level  a  +  bin  FI,  FI  1.  FI3 
and  FI 4.  a  hardclipping  of  a  +  bs:2a  may  be 
conducted. 

A  good  XNOR  could  not  be  performed  in  the 
experiment.  This  problem  is  explained  in  the  follow¬ 
ing.  Without  the  polarizer  P2,  the  combinations  of 
(1.0)  and  ( 0. 1 )  will  result  in  no  polarization  rota¬ 
tion.  A  combination  of  (1,1 )  produces  a  final  polar¬ 
ization  angle  of  18°.  A  combination  of  (0.0) 
produces  -  18°  When  the  polarizer  P3  is  set  at  0°, 
the  combinations  of  (1.0)  and  (0.1)  will  be  bnght 
and  the  combinations  of  (1.1 )  and  (0,0)  will  be  dark. 
According  to  the  Malus  law,  the  combinations  of 

(1,1 )  and  (0.0)  have  the  same  irradiance.  An  XOR 
operation  thus  can  be  obtained.  There  are  three 


approximations  to  an  XNOR  operation.  Neglecting 
the  bias,  transmittances  may  be  calculated  as  follows: 

(a)  Polarizer  P3  is  set  at  18° 
transmittance  of  (1.0)  =  (cos  18°)’ =  0.91 
(0.1)  =  (cos  18°)==0.91 

(l.l)  =  (cos  0°)==1 
(0.0)  =  (cos  32')-'  =  0.72 


(b)  Polarizer  P3  is  set  at  -  18° 
transmittance  of  (1.0)  =  (cos  18°)' =  0.91 
(0.ri  =  (cos  18°)  =  =  0.91 

(l.l)  =  (cos  32°)'  =  0.72 
(0.0)  =  (cos  0°)-=l 

(cj  Polarizer  P3  is  set  at  90° 
transmittance  of  ( 1 .0 )  =  ( cos  90  ° ) '  =  0 
(0.1)  =  (cos  90=)  =  =  0 

(l.l)  =  (cos  72')-  =  0.10 
(0.0)  =  (cos  72°)-  =  0.10 

In  reality,  when  P3  was  set  at  90° .  an  approximation 
of  FO  instead  of  F9  was  obtained.  This  result  was 
similar  to  FO  shown  in  fig.  3.  The  experimental  results 
of  18‘  and  —18'  oriented  polanzers  are  shown  in 
fig.  4,  It  is  clearly  shown  that  these  configurations 
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operations  by  means  of  two  MOSLMs.  The  appli- 
cations  of  optical  parallel  logic  including  Hip-Hop. 
half  adder,  full  adder,  binary  image  subtraction  and 
r  P3  is  $ei  at  ta)  18’  cellular  processing,  have  been  discussed  in  detail  in 
the  literature  [  1-9  ] .  The  advantages  of  the  MOSLM 
arc:  (1)  elcctronically-addressability  and  microcom¬ 
puter-programmability.  ( 2 )  fast  switching  time  (  a:  50 
ecause  the  trans-  ps),  (3)  capability  of  storing  an  input  pattern  with- 
s  in  between  that  out  power  supplied,  and  ( 4 )  low  power  consump- 
instead  of  A  may  tion.  Many  new  architectures  of  hybrid  optical 
INOR  operation.  processing  and  computing  may  be  implemented  using 
iivalent  to  XOR  MOSLMs  based  on  the  proposed  technique. 
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The  color  characteristics  of  a  microchannel  spatial  light  modulator  ( MSL.M )  under  white-light  read  out  illumination  is  exam¬ 
ined.  and  a  system  for  performing  color  optical  processing  operations  using  an  electro-optic  crystal  plate  along  with  the  MSLM  is 
presented.  Experimental  results  for  edge  enhancement  and  image  subtraction  operations  are  demonstrated. 


1.  Introduction 

The  microchannel  spatial  light  modulator 
( MSLM )  is  a  real-time  optical  processing  device  with 
high  optical  sensitivity  and  high  framing  speed.  The 
architecture,  fundamental  operating  characteristics 
and  inherent  space-domain  image  processing  oper¬ 
ations  of  the  device  have  been  reponed  in  the  lit¬ 
erature  [  1.2].  It  is  a  rather  versatile  device  in  that  a 
wide  vanety  of  operations  can  be  performed  such  as 
edge  enhancement,  image  subtraction,  contrast 
reversal,  analog  thresholding  and  hard  clipping.  In 
this  paper  we  consider  the  operation  of  the  MSLM 
in  a  white-light  system  and  examine  the  color  char- 
actenstics  of  the  system  for  vanous  image  processing 
operations. 


2.  MSLM  principles  of  operation 

The  MSLM  consists  of  a  photocathode  and  a 
microchannel  plate  (MCP)  in  proximity  focus  with 
ar  electro-optic  crystal,  all  inside  a  sealed  vacuum 
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i  I 

Input  t-i 

Fig.  I .  Optical  system  wiih  .MSL.M  and  eleciro-optic  crystal  plate. 

tube  [3],  The  electro-optic  crystal  has  a  dielectric 
mirror  over  the  surface  facing  the  MCP  and  pho- 
locathode  side.  Dunng  operation  ( as  in  the  system 
shown  in  fig.  1 ),  an  input  wnte-in  light  incident  on 
the  photocathode  generates  free  electrons  which  are 
multiplied  by  the  MCP  and  proximity  focused  onto 
the  surface  of  the  dielectnc  mirror.  This  spatially- 
varying  charge  distribution  represents  the  input 
image.  A  grid  inside  the  MSLM  controls  the  writing, 
erasing,  and  modulation  level  of  this  surface  charge 
distribution.  The  charge  produces  a  spatially  varying 
electnc  field  across  the  crystal  longitudinally  which 
in  turn  spatially  modulates  the  birefnngence  of  the 
electro-optic  crystal. 

The  read-out  light  passes  through  the  electro-optic 
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crystal  plate  and  is  reflected  back  through  the  plate 
by  the  dielectric  mirror,  effectively  making  a  double 
pass  through  the  plate.  The  output  light  is  thus  spa¬ 
tially  phase-modulated.  Considering  the  polariza¬ 
tion  components  of  the  light  within  the  crystal,  wc 
note  that  the  components  along  the  birefringence  axes 
of  the  crystal  (A",  D  are  phase-shifted  by  different 
amounts  due  to  different  indices  of  refraction.  The 
relative  phase  retardation,  6.  is  defined  as  the  dif¬ 
ference  in  phase  shifts  for  the  polanzation  compo¬ 
nents  along  the  crystallographic  A'  and  Y  axes  and  is 
given  by 


6  =  {27i//.){n,  -n;)2rf . 


(1) 


Here  /.  is  the  wavelength  of  the  read-out  light,  d  is  the 
thickness  of  the  crystal  in  the  MSLM  (2d  is  used  in 
eq.  ( 1 )  because  a  double  pass  is  made),  n,  and  are 
the  indices  of  refraction  along  the  A'  and  T  axes. 

The  electro-optical  crystal  in  the  MSLM  analyzed 
in  this  paper  is  a  300  pm  thick  LiNbOj  single  crystal 
cut  so  that  the  normal  to  the  plate  lies  in  the  (  -  Y, 
Z)  plane  of  the  crystal  and  makes  an  angle  of  55° 
with  the  Z  axis.  This  crystal  cut  optimizes  the  electro 
optic  coefficient  for  the  crystal  plate  in  longitudinal 
mode. 

Now  consider  the  system  shown  in  fig.  1,  ignoring 
the  crystal  P  outside  the  MSLM  for  now.  If  the  input 
polarizer  in  the  read-out  light  is  vertically  onented. 
the  .Vand  Y'  axes  of  the  crystal  in  the  MSLM  are  45° 
from  vertical  ( we  take  the  A'  and  Y'  axes  here  since 
we  are  using  an  optimally  cut  crystal),  and  the  out¬ 
put  polanzer  (analyzer)  is  horizontal,  a  high  con¬ 
trast  image  can  be  produced  at  the  output  plane  when 
a  coherent  source  is  used  for  the  read-out  light  [4]. 
The  intensity  distribution  is  given  by 


/=  A'sin-(<5,'2 )  , 


(2) 


where  A'  is  a  proponionality  constant  ( which  depends 
on  the  charge  distribution  and  hence  on  the  input 
wnte-in  image),  and  6  is  the  relative  phase 
retardation. 

An  equivalent  representation  of  the  read-out  mode 
of  the  MSLM  is  illustrated  in  fig.  2(a).  The  output 
may  be  taken  as  the  relative  phase  retardation  of 
and  represents  the  retardation  due  to  the  crystal  plate 
without  an  input  image  (i.e.  background).  The 
doubiepass  through  the  plate  on  read-out  gives  S  =  2n. 
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Fig.  2.  Propenies  of  system  without  the  crystal  plate  under  white 
light  readout  illumination,  (a)  An  equivalent  transmitunce rep¬ 
resentation.  (b)  Shown  at  top  intensity  as  a  function  of  wave¬ 
length  for  image  and  background  shown  at  bottom. 

Plate  B  represents  the  change  in  S  due  to  the  write- 
in  image. 


3.  White  light  operation 

Assume  that  the  charge  distribution  and  the  result¬ 
ing  indices  of  refraction  are  adjusted  (via  the  grid  in 
the  MSLM)  so  that  for  some  read-out  wavelength. 
Afl.  and  at  some  bright  area  of  the  input  image  the 
relative  phase  retardation  equals  it.  U  is  apparent 
from  eq.  (2)  that  the  output  intensity  at  the  point 
will  be  a  maximum  resulting  in  a  high  contrast 
between  the  background  and  the  image  at  the  output 
plane.  At  some  other  wavelength,  however,  we  see 
from  eq.  (1)  that  in  general  S^n  and  the  output 
intensity  of  the  image  (and  hence  the  contrast)  is 
reduced. 

Note  from  eq.  (2)  that  a  change  in  J  of  r  results 
in  a  contrast  reversal  and  from  eq.  ( 1 )  that  <j  varies 
with  The  change  in  d  due  to  a  change  in  read-out 
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Fig.  3.  System  with  crystal  plaie.  (a)  Equivalem  representation. 
( b  i  Intensity  as  a  function  of  wavelength  for  image  shown  at  top 
and  background  shown  at  bottom 


Fig.  5.  Color  image  subtraaion.  (a ).  ( b )  Input  color objecis.  ( c )  Subtracted  results. 
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wavelength.  JA,  is  obtained  from  eq.  ( 1 )  to  be 

J(5=47rrf(n, -n;)JA/A5  ,  (3) 

where  we  have  assumed  that  the  variation  of  Wi  — 
is  negligible  for  .J/  «ao- 

Evaluating  JX  with  reasonable  estimates  of  the 
parameters  {r/=0.30  mm.  n,  -n;=0.03./o=6x  10“’ 
m ) ,  we  see  that  X  changes  by  n  radians  for  Jx  *  V30. 
This  means  that  phase  retardation  changes  very 
quickly  with  wavelength  and  many  contrast  reversals 
occur  over  the  range  of  visible  light.  Fig.  2(b)  shows 
the  image  intensity  and  background  intensity  distri¬ 
butions  as  functions  of  wavelength.  The  net  result  is 
that  the  contrast  of  the  output  image  is  very  low  when 
white  light  is  used. 

In  order  to  make  the  output  image  under  white 
light  illumination  more  visible,  another  crystal  plate. 
P.  similar  to  the  one  in  the  MSLM.  is  inserted  in  the 
read-out  beam  as  shown  in  fig.  1.  The  principal  sec¬ 
tion  of  the  plate  is  parallel  to  that  of  the  plate  in  the 
MSLM  and  the  effect  of  the  two  is  similar.  The  plate. 
P.  is  not  spatially  modulated  and  its  contribution  to 
<5  changes  relatively  slowly  over  the  white  light  spec¬ 
trum.  An  equivalent  representation  of  the  read-out 
mode  of  the  MSLM  and  the  plate  p  is  shown  in  fig. 
3(a).  The  composite  effect  of  the  two  plates  is  to  act 
like  a  color  filter.  This  is  illustrated  in  fig.  3(b)  where 
the  image  and  background  intensity  distributions  are 
shown  as  a  function  of  X.  The  image  appean  as  one 
color  at  the  output  plane  while  the  background 
appears  as  a  different  color,  that  is  the  well  known 
poianzation  interference.  The  background  and  image 
colors  can  be  modified  by  slightly  rotating  the  plate 
transversely  along  the  vertical  axis,  effectively- 
changing  the  path  length  d  that  the  readout  beam 
travels  within  the  plate. 

The  optical  system  shown  in  fig.  1  was  used  with 
the  same  white  light  source  illuminating  both  the 
write-in  and  read-out.  The  effective  apenure  of  the 
MSLM  is  1 5  mm  in  diameter  and  the  resolution  is 
about  5  lines/mm. 

Fig.  4(a)  shows  a  color  image  of  a  resolution  chan. 
Color  images  of  the  chan  were  produced  with  red 
strips  on  a  green  background  and  also  with  green 
stnps  on  a  red  background.  Color  reversal  is  obtained 
when  the  crystal  plate  is  rotated  about  I.l'  in  the 
azimuthal  direction  (about  the  venical  axis).  Alter- 
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natively,  the  voltage  of  the  plate  can  be  adjusted  to 
reverse  the  colors.  The  minimum  resolvable  strip  is 
about  0. 1 2  mm  on  the  resolution  chan  image. 

An  edge  enhancement  color  image  of  the  lop  views 
a  small  truck,  fig.  4(b).  is  obtained  by  adjusting  the 
voltage  of  the  plate.  The  color  of  the  edge  changes  as 
the  plate  is  rotated. 

For  image  subtraction  the  two  write-in  images  are 
input  separately  to  the  MSLM.  After  the  first  image 
IS  written  in.  the  controlling  grid  voltage  is  changed 
to  give  color  reversal  and  the  second  image  is  entered. 
The  writing  time  cycles  must  be  controlled  properly 
to  get  good  results.  Fig.  5  shows  two  images  to  be 
subtracted  and  the  result  obtained. 


4.  Concluding  remarks 

The  microchannel  spatial  light  modulator  pro¬ 
vides  an  effective  means  of  performing  optical  pro¬ 
cessing  operations  in  color  under  white-light 
illumination.  The  external  crystal  plate  in  conjunc¬ 
tion  with  the  electro-optic  crystal  in  the  MSLM  plays 
an  important  role  in  the  system  by  performing  color 
filtering,  and  allocating  some  colors  to  the  back¬ 
ground  and  others  to  the  object.  .A  variety  of  oper¬ 
ations  can  be  caried  out.  Image  subtraction  and  edge 
enhancement  have  been  demonstrated.  Color  selec¬ 
tion  and/or  reversal  can  be  obtained  by  rotating  the 
external  crystal  plate. 

The  system  or  its  expanded  version  can  potentially 
be  valuable  for  night  vision,  medical  imaging,  and 
interferometric  applications. 
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A  multichannel  parallel  optical  pattern  recognition  system  is  prop-  sec*.  The  synthesis  of  a  large  capacity  matched  filter  is  dis¬ 
cussed.  The  technique  uses  a  phase  mask  and  telescopic  arrangement  for  the  mass  filter  construction  The  processing  capacity  of 
the  proposed  optical  correlator,  which  is  over  400  times  of  a  single  channel  system,  is  evaluated. 


1.  Introduction 


Correlation  detection  has  been  widely  adopted  in 
the  application  of  optical  character  and  pattern  rec¬ 
ognition.  Based  on  the  concept  of  the  optical  matched 
filtering  of  Vander  Lugt  [  1  ].  various  types  of  optical 
correlators  have  been  proposed.  Generally,  these  sys¬ 
tems  can  be  classified  as  either  serial  or  parallel  type. 
Matching  spatial  filters  (MSFs)  are  addressed 
sequentially  for  a  serial  correlator  (2.3),  while  two 
or  more  filters  are  addressed  simultaneously  (4-6) 
for  a  parallel  type. 

In  the  operation  of  parallel  type  correlators. 
Grummet  [4]  utilized  an  Ax  A' array  of  holographic 
lenses.  Liu  and  Duthie  (5).  and  later  Gregory  and 
Liu  [6]  reponedareal  time  correlator  using  a  liquid 
crystal  light  valve  (LCLV).  In  these  systems  the  ref¬ 
erence  beams  were  fixed  in  one  direction,  such  that 
all  the  cross-correlations  and  auto-correlations  would 
be  displayed  at  about  the  same  region.  If  a  correla¬ 
tion  peak  is  observed,  the  input  scene  should  contain 
one  of  the  reference  objects.  However,  it  is  difficult 
to  determine  which  reference  object  is  actually  cor¬ 
related  with  the  input.  These  systems  are  therefore 
inadequate  in  distinguishing  more  than  one  object. 
Nevenheless.  these  systems  can  be  applied  to  detect 
an  object  with  fimte  onentations.  Another  drawback 
of  this  kind  of  systems  occurs  in  the  signal-to-noise 
ratio  (SNR)  which  decreases  as  the  number  of  the 
matched  filters  increases. 

In  this  paper,  we  propose  a  parallel  optical  cor¬ 


relator.  which  separates  the  output  correlation  func¬ 
tions.  This  correlator  utilizes  reference  beams  with 
different  directions  in  constructing  the  MSFs.  Since 
the  output  correlation  diffraction  is  based  upon  the 
direction  of  the  spatial  carrier  frequency,  the  cor¬ 
relation  distribution  from  each  MSF  will  appear  at 
different  diffracted  locations.  Thus.  A’xA’  channels 
can  be  synthesized  by  employing  a  phase  mask  to 
diffract  the  reference  beam  into  A’xA’  directions. 
Because  the  correlation  outputs  are  diffracted  in  dif¬ 
ferent  locations,  SNR  is  independent  of  the  number 
of  channels. 


2.  System  description 

With  reference  to  the  multichannel  optical  corre¬ 
lator  of  fig.  1.  a  collimated  laser  beam  is  incident  on 
a  phase  mask  P  to  produce  A'x.V  equi-intensity 
beams  in  different  directions.  These  diffracted  beams 
would  propagate  through  a  conventional  matched 
spatial  filtering  setup,  as  shown  in  the  figure.  Since 
the  diffraction  angles  are  assumed  to  be  small,  all  of 
the  diffracted  beams  would  pass  through  the  same 
optical  elements.  Thus,  an  A'x  A  array  of  image  spec¬ 
tra  is  produced  in  the  Fourier  transform  plane.  The 
separation  between  two  adjacent  spectra  is /lO.  where 
/,  is  the  focal  length  of  the  Fourier  transform  lens  L,. 
and  a  the  angle  of  the  first-order  diffraction,  a  is  also 
the  angle  between  two  adjacent  diffracted  beams.  S, 
is  a  selecting  screen  which  allows  only  the  desired 
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3.3.  Relations  of  system  parameters 


Since  the  diffraction  angle  from  the  phase  mask  is 
a,  the  separatioin  of  the  object  spectra  at  the  filter 
plane  is  fa.  If  an  angular  separation  of  the  reference 
beam,  Ka,  is  needed  to  avoid  overlapping,  then  the 
angular  magnification  factor  required  for  the  teles¬ 
copic  structure  should  be  K=flf. 

In  view  of  fig.  2,  the  relation  between  rf;  and  can 
be  obtained  with  geometrical  optics,  i.e., 


d^=f+flK-dJK' 


(1) 


where  factor  K  should  be  sufficiently  large,  such  that 
output  correlation  distributions  could  be  separated. 
By  neglecting /J//^-d|//w^  as  composed  with/j,  eq. 
(1 )  car.  be  reduced  to 


dz=f. 


(2) 


=/j(l +/.//:)• 


(3) 


ABC 

XYZ 


Parallel 


Correlation 

With 


3.4.  Processing  capacity 


Suppose  the  width  of  input  object  transparency  is 
H'  and  the  focal  length  of  the  Founer  transform  lens 
is/, .  An  angular  separation  of  2  W7 f  for  the  adjacent 
reference  beams  would  be  required  to  separate  the 
adjacent  output  correlation  distributions.  For  exam¬ 
ple,  if  the  maximal  separation  angle  leaving  the  teles¬ 
copic  structure  is  about  60°,  we  would  have  a 
maximum  of  7t/,/(6H')  filters  in  one  dimension. 
Further  assume  that  f  =  S0  cm  and  U'=2  cm.  The 
maximum  number  of  the  matched  filters  in  two 
dimensional  representation  would  be  over  400. 

In  order  to  avoid  channel  overlapping,  the  angular 
separation  of  the  reference  beam  should  be  2Wf.  If 
the  distance  between  neighbonng  matched  filters  is 
u,  the  diffraction  angle  a  =  u/f.  The  angular  mag¬ 
nification  K  can  be  determined  as 


Furthermore,  to  obtain  the  same  angular  separa¬ 
tion  fa  of  the  reference  beams,  the  distance  from  Lj 
to  the  filter  plane  should  be 


K=2iV/u. 


(4) 


For  instance,  if  W'=2  cm  and  u  =  0.4cm.  then  K=  10. 
The  fact  that  K  is  larger  than  unity  demonstrates  that 
a  telescope  struaurc  is  required  to  avoid  overlapping. 
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Fig,  3.  An  experimental  demonstration. 


113 


m 


•  •a*  •-*  *•’  %“  V  V  • 


Volume  64.  number  2 


OPTICS  COMMUNICATIONS 


15  October  1987 


4.  Experimental  demonstration 

Instead  of  using  a  2-D  phase  mask,  a  1-D  sinu¬ 
soidal  phase  grating  is  used  in  our  experimental 
demonstration.  The  phase  grating  provides  first,  and 
second  order  diffractions.  Including  zero  order  beam 
a  total  of  five  diffraction  beams  is  obtained.  The  spa¬ 
tial  frequency  of  the  grating  is  20  lines/mm,  and  dif¬ 
fraction  angle  a  is  therefore  1/100  radian.  The  objects 
used  in  our  experiments  consist  of  six  english  char¬ 
acters.  as  shown  in  fig.  3.  The  focal  length  of  L,  and 
L;  are  80  cm  and  that  of  L3  is  10  cm.  The  distance 
from  lens  Lj  to  the  filter  plane  was  then  calculated 
from  eq.  ( 3 ),  to  be  20  cm. 

With  reference  to  fig.  1,  the  -^1  order  reference 
beam  would  superimpose  the  —  1  order  object  beam. 
If  the  phase  mask  does  not  have  a  symmetric  dif¬ 
fraction  pattern,  an  additional  mirror  for  the  refer¬ 
ence  beam  or  the  object  beam  may  be  used  to 
combine  the  positive  orders  of  reference  and  object 
beams.  In  the  case  of  two-dimensional  diffraction, 
an  .Amici  prism  may  be  used  to  convert  the  beams 
such  that  the  same  order  of  reference  and  object 
beams  may  overlap  at  the  filter  plane.  However,  since 
the  experiment  penbrmed  was  one  dimensional,  only 
one  mirror  is  used  for  the  reference  beam. 

In  the  construction  of  the  matched  filters,  one  sees 
that  matched  filters  can  be  synthesised  one  at  a  time 
with  different  orders  of  the  reference  beams,  that 
include  the  zero-order.  The  correlation  outputs  are 
observ  ed  at  different  locations  simultaneously  with 
respect  to  the  carrier  frequencies  of  the  MSFs.  .An 
expenmental  result  obtained  with  this  technique  is 
also  shown  in  fig.  3.  In  this  figure,  the  input  scene  is 
applied  simultaneously  to  the  filters  and  the  corre¬ 
lation  results  are  shown  in  the  photos.  This  result 


illustrates  the  capability  of  constructing  a  mass 
capacity  correlator  as  we  proposed. 

5.  Conclusion 

We  have  discussed  a  parallel  optical  correlator 
which  has  a  processing  capacity  of  more  than  400 
times  over  the  conventional  single  channel  correla¬ 
tor.  The  system  will  have  the  same  output  SNR  as  a 
single  channel  correlator.  This  proposed  technique  is 
rather  easy  to  implement  since  no  mechanical  scan¬ 
ner  IS  used  for  the  mass  channel  correlations.  This 
technique  may  offer  application  to  rapid  mass  pat¬ 
tern  recognitions. 
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A  programmable  optical  system  that  can  perform  binary  Boolean  logic  operations  anth  a  microchannel  spatial  light 
modulator  (MSLM)  is  presented.  The  MSLM  is  used  as  an  adder,  an  inverter,  a  subtractor,  or  a  buffer.  We  used 
three  liquid-crysul  televisions  with  a  computer  as  input  inurfacing  devices.  Through  the  use  of  iu  feedback  loop, 
the  system  can  consecutively  execute  a  series  of  logic  operations.  Experimental  results  are  provided. 


Optical  Boolean  logic  gates  are  the  basic  elements  in  a 
digital  optical  computer.  With  advancing  techniques, 
various  schemes  to  perform  optical  parallel  logic  gates 
have  been  proposed.  Some  of  these  implementations 
utilized  different  spatial  light  modulators  (SLM’s), 
such  as  Pockels-readout  optical-memor\’  devices,^-^ 
twisted  nematic  liquid-crystal  detdces,^  liquid-crystal 
light  valves*  (LCLV’s),  liquid -crystal  televisions® 
(LCTV^’s),  and  magneto-optical  devices.® 

The  newly  developed  microchannel  spatial  light 
modulator’  (MSLM)  is  a  promising,  versatile,  optical¬ 
ly  addressed  SLM.  It  offers  another  means  to  imple¬ 
ment  optical  parallel  Boolean  gates.  Warde  and 
Thackara'  demonstrated  a  method  using  a  MSLM  to 
execute  binary  logic  operations.  In  their  experiment, 
two  input  operands  must  be  fed  into  the  system  se¬ 
quentially.  Kara  et  al.^  also  presented  a  scheme  that 
can  perform  all  16  basic  Boolean  logic  operations. 
Their  system  is  complicated  and  consists  of  three 
MSLM’s  and  six  beam  splitters.  In  addition,  the  in¬ 
put  functions  are  not  programmable. 

In  this  Letter  we  discuss  a  system  that  car.  execute 
all  16  basic  two-operand  Boolean  operations  with  a 
MSLM  and  three  LCTV’s.  The  MSLM  can  be  used 
as  an  adder,  a  subtracter,  an  inverter,  or  a  buffer.  The 
LCTV’s  with  a  microcomputer  are  used  as  program¬ 
mable  input  interfacing  devices.  The  basic  advantage 
of  the  system  is  the  real-time  programmable  process¬ 
ing  capability.  By  adding  a  feedback  loop  to  the  sys¬ 
tem  one  can  expand  its  function  to  execute  Boolean 
calculations  consecutively. 

The  MSLM  is  a  reflective-type  electro-optical  SLM. 
It  consists  of  a  photocathode,  focusing  electrodes,  a 
microchannel  plate,  a  mesh  electrode,  and  an  electro- 
optical  (E-0)  crystal  plate  positioned  in  a  sealed  vacu¬ 
um  tube.  In  operation,  the  write-in  light  intensity 
distribution  produces  an  electrical  charge  distribution 
on  the  inner  side  of  the  E-0  crystal  plate.  The  charge 
distribution  induces  an  electrical  field  within  the 
plate.  This  field  in  turn  modulates  the  phase  retarda¬ 
tion  between  the  x  and  y  components  of  the  readout 
light  that  makes  a  double  pass  through  the  plate.  Af¬ 
ter  it  passes  through  an  analyzer,  the  output  intensity 
can  be  expressed  as® 


7(z,  y)  w  L  single, \\  +  cjjx,  y)),  (1) 

where  is  the  read-out  illumination  intensity,  Cj  is  a 
constant  determined  by  the  material  property  and  the 
cut  angle  of  the  crystal  plate,  co  is  a  parametric  con¬ 
stant  depending  on  the  bias  voltages  on  the  photocath¬ 
ode  and  all  the  electrodes,  Vt,  is  the  bias  voltage  across 
the  E-0  crystal  plate,  and  7„(x,  y)  is  the  intensity  of 
the  write-in  light.  When  the  bias  voltages  are  proper¬ 
ly  set,  the  MSLM  can  perform  a  number  of  optical 
operations*®'*'  in  its  internal  mode  processing.  These 
operations  include  image  thresholding,  addition  and 
subtraction,  contrast  reversal,  contrast  enhancement, 
edge  enhancement,  hard-clip  thresholding,  and  gray- 
level  contour  extraction.  Some  of  these  operations 
can  be  utilized  to  carry  out  OR,  NEGATION,  XOR,  etc. 
in  Boolean  algebraic  operations. 

In  our  optical  system  we  use  the  commercially  avail¬ 
able  LCT\'  as  a  programmable  object.  The  working 
principle  of  the  LCTV  has  been  described  well  in  the 
literature.®  The  major  advantage  of  the  LCTV  is  that 
it  can  be  connected  directly  to  a  microcomputer  for 
generation  of  optical  patterns. 

There  are  16  basic  operations  for  two-operand  Bool¬ 
ean  algebra,  as  shown  in  Table  1.  For  simplicity,  we 
shall  consider  only  the  positive  logic,  for  which  the 
high-level  intensity  represents  logic  one  and  the  low- 
level  intensitv'  represents  logic  zero.  The  sixteen  op¬ 
erations  can  be  classified  into  two  categories:  (1)  Ad¬ 
ditive  operations  include  f  3,  Fj,  Fe,  F-„  Fs,  F9,  Fio,  Fu, 
Fi2,  and  F13.  (2)  Multiplicative  operations  include 
Fi,  F2,  F4,  and  Fu-  Note  that  Fo  and  F15  can  be 
included  in  either  category. 

Figure  1  shows  the  experimental  setup.  The  micro¬ 
computer  is  used  to  generate  programmable  input 
data  arrays  into  the  LCT\*’s  and  to  control  the  opera¬ 
tion  of  the  optical  system.  The  output  data  can  be 
detected  by  a  charge-coupled-device  (CCD)  camera, 
which  either  displays  the  output  on  a  T\’  monitor  for 
observation  or  feeds  it  back  into  the  microcomputer 
for  further  execution  of  the  logic  operations. 

In  additive  logic  operations,  the  computer  wTiies  an 
operand  (image  pattern)  into  LCTVl  and  the  other 
operand  into  LCTV2  and  simultaneously  sets  LCTV3 
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Table  1.  Sixteen  Possible  Functione  of  Two  Binary  Variables  for  Poaitive  Logic 
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Fig.  1.  Schematic  diagram  of  a  programmable  optical  Bool¬ 
ean  logic  system:  input  illumination;  PB.  beam  splitter; 

L's.  imaging  lenses;  PBS.  polarizing  beam  splitter;  read¬ 
out  illumination;  P„,  output  plane. 


at  a  uniformly  transparent  state.  Lenses  1  and  2  will 
image  the  patterns  displayed  on  LCTVl  and  LCTV2 
onto  the  input  window  of  the  MSLM.  LCTV3  has  no 
effect  on  this  process  since  it  is  at  a  transparent  state. 
To  execute  OR,  the  MSLM  is  operated  in  the  intensity 
hard-clipping  mode.  In  this  mode,  the  input  and  out¬ 
put  intensities  are  related  by  a  curve  as  shown  in  Fig.  2. 
Thus  only  the  overlap  of  the  dark  parts  of  both  input 
patterns  gives  a  zero  output  intensity,  while  the  rest  of 
the  result  at  the  output  is  equal  to  intensity  /<,.  In 
other  words,  the  intensity  distribution  on  the  output 
plane  corresponds  to  the  OR  operation  of  the  two  input 
operands.  If  we  add  a  half-wave  voltage  to  the  E-0 
crystal  bias  voltage  V^,,  the  contrast  of  the  output 
would  be  reversed.  This  yields  the  NOR  of  the  input 
operands.  In  a  similar  manner,  functions  F3,  F,,  Fe. 
Ft,  Fg,  Fg,  Fio,  Fn,  F12,  and  F13  can  be  achieved.  To 
execute  XOR,  the  parameters  in  Eq.  (1)  are  selected  to 
be  CiV*  =  «■  and  c^h  =  Thus  we  can  see  that  the 
output  intensity  would  be  zero  if  the  write-in  intensity 
were  either  zero  or  On  the  other  hand,  if  the  write- 
in  intensity  were  /,72,  the  output  intensity  would  be  lo- 
This  relationship  between  input  and  output  intensi¬ 
ties  is  illustrated  in  Fig.  3,  which  corresponds  to  the 
XOR  of  the  input  operands.  If  we  add  a  half-wave 
voltage  to  Vb,  the  output  contrast  would  be  reversed, 
which  corresponds  to  the  NXOR  operation. 

For  the  multiplicative  operations,  the  computer 
would  write  a  first  operand  into  LCTVl  and  a  second 
operand  into  LCTV3,  whereas  LCTV2  is  programmed 
to  be  logic  zero  (i.e.,  LCTV2  is  in  opaque  stage),  and 
the  MSLM  is  operated  in  the  hard-clipping  mode. 
Thus,  when  the  operand  on  LCTVl  is  imaged  onto 
LCTV3.  the  intensity  distribution  immediately  be¬ 
hind  LCTV3  would  be  the  multiplication  of  the  two 


input  operands.  By  adding  a  half-wave  voltage  to  the 
Vg,  we  can  get  the  product  negation  of  the  inputs. 
With  reference  to  this  basic  principle,  the  functions 
Fi,  F2,  Fi,  Fu  can  be  achieved  with  this  setup.  Func¬ 
tions  Fo  and  F15  can  be  obtained  by  operating  the 
MSLM  in  a  saturated  mode,  so  that  the  output  inten¬ 
sity  would  be  zero  or  /o,  depending  on  the  voltage 
across  the  E-0  crystal  plate  regardless  of  the  input 
operands. 

If  one  uses  the  feedback  loop,  the  optical  system  can 
perform  sequential  Boolean  operations.  By  utilizing 
the  clock  pulses  of  the  computer  after  each  operating 
cycle,  the  CCD  camera  can  feed  back  the  output  result 


Fig.  2.  The  input-output  intensity  relationship  of  a  hard- 
clipping  MSLM. 


Fig.  3.  The  input-output  intensity  relationship  of  a 
MSLM  for  executing  XOR. 
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Fig.  4.  Elxperimentel  results  of  the  16  Boolean  operations. 


C  (A+fi)C 

Fig.  5.  A  demonstration  of  a  consecutive  logic  operation. 

to  the  computer.  The  computer  can  use  this  as  a  new 
input  operand  for  the  nen  operating  cycle. 

Finally,  for  experimental  demonstrations,  the  16 
Boolean  operations  are  shown  in  Fig.  4.  In  the  experi¬ 
ment.  the  input  illumination  is  from  a  white-light 
point  source  and  the  readout  illumination  is  from  a 
He-Ne  laser.  From  these  results,  we  see  that  the 
parallel -processing  advantage  of  optics  is  fully  uti¬ 
lized.  liie  speckle  noise  in  the  results  is  due  to  the 
high  degree  of  coherence  of  the  readout  laser  light. 
Tne  distortion  of  the  output  comes  mainly  from  the 
imperfection  of  the  microchannel  plate  and  the  photo¬ 


electron  imiiging  system  within  the  MSLM;  it  also 
arises  from  the  nonunifonnity  of  the  E-0  crystal  plate. 
Although  the  results  are  not  ideal,  we  believe  that  they 
can  be  sigitificantly  improved  with  an  improvement  in 
the  MSLM.  Further,  Fig.  5  shows  an  experimental 
result  of  a  consecutive  logic  operation  obtained  with 
this  setup.  This  demonstration  indicates  that,  in 
principle,  the  hybrid  system  can  perform  a  series  of 
consecutive  operations.  In  other  words,  it  can  work  as 
a  Boolean  algebraic  calculator. 

We  have  presented  an  optical  system  that  is  capable 
of  performing  binaiy  Boolean  logic  operations  with  a 
MSLM  and  LCT\'’b.  The  logic  states  of  the  input  and 
output  data  arrays  are  represented  by  light  intensity. 
Combining  the  merits  of  the  MSLM,  the  LCTV^’s,  and 
a  computer,  the  system  offers  the  advantages  of  opti¬ 
cal  parallel-processing  capability,  programmabilit>’, 
and  feedback  consecutive-processing  flexibility. 
With  advances  in  MSLM  performance,  the  perfor¬ 
mance  of  this  optical  system  is  expected  to  improve, 
resulting  in  faster  response,  higher  resolution,  end  less 
image  distortion. 
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Electro-Optics  Laboratory 
Electrical  Engineering  Department 
The  Pennsylvania  State  University 
University  Park,  PA  16802 


Abstract 


This  paper  describes  the  methods  of  implementing  an  optica 
half-adder  and  a  full  adder  utilizing  programmable  liquid  crystal 
televisions  (LCTV).  The  concept  of  constructing  an  optical  full  adder  is 
based  upon  the  realization  of  an  optical  read-only-memory  (OROM).  An 
experimental  demonstration  of  binary  number  addition  performed  by 
optical  half-adder  is  given. 
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I.  INTRODUCTION 


Prior  to  our  discussion,  ve  note  that  the  optical  binary  adder,  when 


used  in  digital  optical  computing,  is  a  basic  part  of  the  central 


processing  unit  (CPU).  Methods  of  making  an  optical  half-adder  and  full 


adder  have  been  proposed  by  several  investigators  in  the  past  few  years 


[1,2].  Having  already  built  a  4-bit  half  adder,  Lohmann  and  Veigelt  have 


proposed  a  1-bit  full  adder  that  is  based  on  the  spatial  filtering 


technique  (1).  In  order  to  implement  a  1-bit  half-adder,  Khan  and  Nejib 


[2]  have  proposed  an  optical  structure  that  employs  liquid  crystal 


switches.  In  addition  to  these,  we  have  recently  proposed  a  method  that 


performs  XOR  logical  operations  utilizing  liquid  crystal  televisions 


(LCTV)  [3].  The  XOR  logical  operation  is  in  fact  a  key  operation  in  a 


binary  adder. 


The  basic  difference  between  a  half-adder  and  a  full  adder  is  the 


carry-transmission.  A  1-bit  half-adder,  however,  does  not  require  carry 


input.  If  two  bits,  Ai  and  Bi,  are  added  together,  the  half-adder  would 


produce  a  sum  Si,  and  a  carry  Ci+1,  i.e.,  Si=Ai0Bi,  Ci+1  =  Ai-Bi.  In  a 


1-bit  full  adder,  three  inputs,  Ci,  Ai,  and  Bi,  would  also  produce  a  sum 


and  a  carry,  i.e..  Si  =  Ai  0  Bi  0  Ci  and  Ci+1  =  (Ai  0  Bi)’Ci+Ai* Bi.  In  a 


n-bit  full  adder  (n>l),  the  carry  is  transfered  bit  by  bit  from  the  least 


significant  bit  (LSB)  to  the  most  significant  bit  (MSB).  We  stress  that 


the  main  difficulty  in  building  an  n-bit  optical  full  adder  lies  within 


the  realization  of  carry-transmission.  To  overcome  this  problem,  the 


optical  Read-only-Memory  (OROM)  is  introduced. 
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In  this  paper,  ve  propose  a  nulti-channel  optical  half-adder  using 
LCTVs.  This  optical  half-adder  is  capable  of  performing  the  XOR,  AND, 
NOT,  and  OR  logical  operations.  An  experimental  demonstration  of  the 
proposed  half-adder  is  provided.  Finally,  by  introducing  OROM  to  the 
system,  ve  can  realize  a  2-bit  optical  full  adder. 

II  AN  OPTICAL  HALF-ADDER 

The  logical  operations  of  a  half-adder  produce  a  sum  Si  and  a  carry 
Ci-t-1  such  as: 

Si  =  Ai  ©  Bi  ,  (1) 

Ci+1  =  Ai-Bi  ,  (2) 

where  Ai  and  Bi  are  the  input  bits.  Since  XOR  and  AND  operations  are 
required  in  a  half-adder,  they  can  easily  be  implemented  with  LCTVs  as 
shown  in  Fig.l.  In  the  optical  system,  two  microcomputers  are  used  in 
order  to  produce  the  image  patterns  for  A  and  B  onto  two  LCTVs.  Two 
LCTVs  perform  the  XOR  operations  with  the  polarization  logic  in  which  the 
logical  "O's"  are  encode  on  horizontal  polarization  while  the  logical 
"I's"  are  encoded  in  vertical  polarization.  To  perform  the  XOR  and  AND 
operations  in  parallel,  it  is  required  that  pattern  B  is  written  twice 
(e.g.,  B2  is  the  extra  copy  of  B  in  Fig.l).  The  sum,  S,  produced  by  the 
LCTVs  is  directly  detected  by  an  cinalyzer.  The  intensities  of  patterns  A 
and  B  can  be  combined  together  to  perform  the  logical  operation  OR,  which 
is  basically  performed  in  the  intensity  logic.  We  note  that  a  polarizer 
set  in  the  contrast  reverse  mode  can  be  using  as  a  NOT  gate.  Therefore, 
an  AND  gate  can  be  implemented  with  the  optical  structure  shown  in  Fig. 4. 
In  this  structure,  the  DeMorgan's  Theorem  is  applied,  such  as. 


In  experimental  demonstrations,  ve  used  four-channel  half  addition 
in  parallel.  Ue  have  chosen  the  following  values  to  reflect  the  general 
case. 

A1  =  0,  A2  =  1,  A3  =  1,  A4  =  0  ;  (4) 

B1  =  0,  B2  =  1,  B3  =  0,  B4  =  1  .  (5) 

Consequently  the  output  data  would  be, 

SI  =  0,  S2  =  0,  S3  =  1,  S4  =  1  ;  (6) 

Cl  =  0,  C2  =  1,  C3  =  0,  C4  =  0  .  (7) 

The  results  obtained,  which  include  two  input  patterns  and  two  output 
patterns,  are  shown  in  Fig. 3.  Note  that  the  distance  between  two  LCTVs 
should  satisfy  the  following  inequality  condition  [3]: 

2  <  d  /  >,,  (8) 

where  z  is  the  distance  between  two  LCTVs,  d  is  the  width  of  a  square 
resolution  cell,  and  X  is  the  wavelength  of  the  light  source.  In  our 
experiment,  a  He-Ne  laser  oscillating  at  X  =  632.8  nm  is  used.  Since 
the  resolution  of  LCTV  d  =  370  urn,  we  set  the  distance  between  the  LCTVs 
to  about  20cm  (see  Fig.l). 

Although,  15x20  pixels  were  used  to  represent  1-bit  data  in  our 
experiment,  fewer  pixels,  as  small  as  one  pixel  in  1-bit,  can  be  used  in 
this  experiment.  To  reduce  the  coherent  artifact,  a  white  light  source 
can  be  used  in  the  system  [4]. 


III.  AN  OPTICAL  FULL  ADDER 


To  add  the  new  carry-in  to  the  inputs  of  A  and  B  at  the  LSB,  the 
n-bit  full-adder  should  have  the  capabilities  of  performing  the 
carry-transmission  (between  the  successive  bits  from  LSB  to  MSB)  and  of 
detecting  the  overflow  errors.  For  an  n-bit  full  adder,  Si  and  Ci  can  be 
obtained  by  recurrent  equations. 

SSi  -  Ai  @  Bi  0  CCi,  (9) 

CCi+1  =  (Ai  0  Bi)CCi+Ai*Bi,  (10) 

where  SSi  represents  the  ith  sum  bit  and  CCi  denotes  the  ith  carry  output 
bit  of  full  adder. 

The  simplest  means  of  implementing  a  full  adder  is  to  feed  the 
carries  bit  by  bit.  This,  however,  is  not  an  easy  task  tn  perform  when 
using  an  optical  processor.  Nevertheless,  with  the  addition  of  an  OROM, 
an  optical  processor  can  perform  the  carry  transmission,  as  proposed  in 
Fig. 4  and  Fig. 5.  In  other  words,  the  OROM  can  allows  a  full  adder  to 
perform  addition  in  parallel  without  feeding  carries.  Ue  further  note 
that  OROM  is  a  digital  logic  device  that  can  be  implemented  with  any 
binary  logical  function. 

In  a  2-bit  full  adder,  the  sum  SS  and  the  Cout  can  be  produced  by  Si 
and  Ci  that  have  been  obtained  from  the  output  of  the  improved 
half-adder.  Let  us  now  state  the  following  relations: 


551  =  Al  0  B1  0  Cin  =  SI,  (12) 

CC2  =  Sl-Cin+Al-Bl  =  si'Cin+C2,  (13) 

552  =  S2  0CC2  =  S2CC5+S2CC2,  (14) 

Cout  =  Si*S2Cin+C2S2+C3,  (15) 


where  Ai  and  Bi  are  the  input  patterns,  Cin  is  the  carry  input.  Si  and  Ci 
are  the  ith  output  sum  and  carry  obtained  from  the  improved  half-adder. 
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and  Cout  is  the  carry  output  of  the  full  adder.  Ue  stress  again  that  The 
relations  of  Eq.  (12)-(15)  can  be  implemented  with  an  optical  processor 
using  OROM  ,  as  shown  in  Fig. 6.  The  logic  diagram  for  this  setup  is 
illustrated  in  Fig. 7. 

Overflow  error  occur  whenever  the  addition  of  two  numbers  results  in 
a  sum  which  is  too  large  or  too  small  to  be  represented  by  n  bits. 
Consequently,  the  detection  of  overflow  errors  is  required  for  a  full 
adder.  This  is  done  by  utilizing  the  well-known  rules,  for  unsigned 


number. 


E  B  Cout, 


and  for  signed  number, 

E  =  Cn@Cn+l,  (17) 

where  E=0  and  E=1  indicate  overflow  error  and  no  overflow  error 
respectively. 


Thus,  in  a  2-bit  full  adder,  we  would  have, 

E  =  CC2@Cout  =  CC2  *00111+^ 'Cout  (18) 

This  logical  operation  may  be  performed  by  an  optical  processor  using  an 
OROM,  as  proposed  in  Fig. 8. 


IV.  CONCLUSION 


Ue  have  demonstrated  method  of  building  an  optical  half-adder  using 
a  programmable  LCTVs.  An  experimental  demonstration  shows  that  a  4-bit 
half-addition  can  be  obtained.  This  result  shows  the  general  case  for 
optical  half-adder.  The  optical  half-adder  can  be  easily  extended  to 
perform  larger-arrays-number  addition,  by  simply  changing  the  computer 


program  of  the  microcomputer.  Ve  note  that  no  extra  coding  procedure  is 
required  in  the  half-adder,  since  the  number  vas  automatically  encoded  by 
the  LCTV.  To  extend  a  half-adder  to  perform  a  full  adder  operation,  ve 
introduce  an  OROM  for  carry  transmission  and  overflow  error  detection. 
An  optical  architecture  of  2-bit  full  adder  using  OROM  is  also  proposed 
in  this  paper. 
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Figure  Catalog 


FIG.l  An  Optical  Setup  for  4-bit  Parallel  Half-adder;  A,  B,  inputs; 
Ml,  M2,  mirrors;  PI,  P2,  P3,  Polarizers. 

FIG. 2  An  "AND"  Logical  Gate  Using  Three  Polarizers:  X,  Y,  inputs; 
Z,  output;  PI,  P2,  P3,  polarizers. 

FIG. 3  An  Experimental  Demonstration  of  an  Optical  Half-Adder: 
A, B, inputs;  S,Sum;C, Carry. 


FIG. 4  A  Block  Diagram  of  a  n-bit  Full  Adder. 


Fig. 5  An  Improved  Half-adder. 


FIG. 6  Optical  Implementation  of  OROM  for  Sum  bit  and  Carry  out. 


(a)  Sum  bit  SS2. 


(b)  Carry  out  Cout. 


FIG. 7  A  Logic  Diagram  of  OROM  for  Sum  bit  and  Carry  out. 


(a)  Sum  bit  SS2. 


(b)  Carry  out  Cout. 


FIG. 8  An  Overflow  Detector  System. 


(a)  Logical  Diagram. 


(b)  Optical  Implementation. 
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DIGITAL  OPTICAL  ARCHITECTURES 


FOR  MULTIPLE  MATRIX  MULTIPLICATION 


Francis  T.S.  Yu,  Taiwei  Lu  and  Miao-Fu  Cao 
Department  of  Electrical  Engineering 
Pennsylvania  State  University 
University  Park,PA16802 


ABSTRACT 


Two  optical  architectures  utilizing  a  binary  number 
algorithm  for  multiple  matrix  multiplication  are  presented.  An 
inner-product  technique  is  utilized  in  one  of  the  architectures, 
so  that  multiple  matrix  multiplication  can  be  performed  in 
parallel.  For  the  other  architecture,  systolic  array  processing 
along  with  the  inner-product  method  are  used.  This  technique 
would  alliviate  the  bottleneck  effect  that  is  due  to  the 
electro-optic  interfacing  and  the  complexity  of  the  high  order 
matrix  operations.  Ve  show  that  both  architectures  can  offer 
high  accuracy  and  high  speed  processing  capabilities. 
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Optical  matrix  multiplication  is  one  of  the  prominent  areas 
in  optical  computing.  In  early  1970's,  Lee  et  al.[l]  proposed  a 
method  to  perform  multiple  matrix  multiplication  using  the 
Fourier  transform  property  of  lenses.  Another  architecture  was 
later  developed  by  Nakano  et  al.(2].  They  utilized  a  linear 
array  of  LED's  along  with  a  combination  of  spherical  lenses  and 
cylindrical  lenses  to  perform  triple  matrix  multiplication.  Some 
efforts  have  also  been  made  to  carry  out  high  speed  matrix-matrix 
and  triple  matrix  multiplication  [3-4). 

Ve  shall  however  in  this  paper  describe  a  method  for 
multiple  binary  number  multiplication.  The  essential  merit  of 
this  proposed  method  is  that  the  multiplications  and  summations 
of  digits  are  performed  in  parallel. 

We  shall  discuss  two  optical  architectures  for  multiple 
matrix  multiplication.  The  first  architecture  employs  the 
inner-product  method  to  carry  out  Multiple  Matrix  Multiplication 
(MMM)  for  which  high  accuracy  and  high  speed  operations  can  be 
achieved.  The  second  architecture  combines  the  inner-product 
method  with  the  systolic  array  engagement  technique.  This 
inner-product-systolic  technique  is  capable  of  large  matrix 
multiplication  and  can  also  be  applied  to  linear  and  bilinear 
transformations.  Several  preliminary  experimental  demonstrations 
of  these  proposed  techniques  are  provided. 


>>■  Page  3  Qn 


I 


■i- 

W  .• 
V. 

s 


y.. 


of  these  proposed  techniques  are  provided. 

IZ.  System  Description 

1)  Multiple  Binary  Number  Multiplication 

In  most  electronic  computers  the  binary  number 
multiplication  is  performed  sequentially.  The  operation  of  the 
multiplication  of  three  binary  numbers  by  a  computer  is  carried 
out  as  follows: 

The  three  binary  numbers  are 
a  =  111  ; 
b  =  110  ; 
c  *  Oil  . 


!■  " 


'b'  is  multiplied  by  the  least  significant  bit  (LSB)  of  'a';  'b' 

is  shifted  one  bit  to  the  left,  multiplied  by  the  second  bit  of 
'a';  'b'  is  shifted  left  again,  multiplied  by  the  most 

significant  bit  (MSB)  of  'a';  then  a  summation  is  taken  over  the 
three  multiplication  results  and  the  intermediate  result  'ab'  is 
obtained: 

10  1  X  0 

10  1x1 

+  10  1  X  1 

11110 

ab  =  a  X  b  =  101  X  110  =  11110  . 
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The  same  procedure  is  repeated  between  the  intermediate  result 
'ab'  and  'c'  to  produce  the  result  abc. 

11110  X  1 

11110  X  1 

+  11110  X  0 

10  110  10 

abc  «  ab  X  c  .  11110  x  Oil  -  1011010  . 

However  the  three  binary  number  multiplication  can  be  performed 
in  parallel  using  an  optical  system  as  shown  in  Figure  1(a).  In 
the  optical  system,  'a'  is  encoded  on  a  1-D  spatial  light 

modulator  (SLM),  b  and  c  are  pre-shifted  and  encoded  on  two  2-D 
SLH's.  The  digit  '1'  is  represented  by  the  transparent  spots  on 
masks,  whereas  '0'  and  blank  are  opaque.  The  three  masks  are 
placed  at  planes  XI,  X2  and  X4  respectively.  The  intermediate 
product  ab  is  obtained  at  plane  X3  and  the  final  result  abc  is  at 
the  plane  X5.  Notice  that  the  results  are  in  mixed  binary  form 
to  avoid  carries.  It  is  easy  for  a  computer  to  convert  mixed 
binary  numbers  to  binary  numbers(6].  Figure  1(b)  shows  the 
optical  implementation  for  triple  binary  number  multiplication. 
Both  the  binary  number  multiplication  and  the  matrix 
multiplication  involve  many  multiplication  and  addition 
operations.  In  the  system,  the  multiplications  are  performed  by 
the  transmit tances  of  the  SLH's,  and  the  additions  are  carried 
out  by  focusing  the  light  into  a  point.  An  incoherent  collimated 
light  is  incident  on  plane  XI;  the  cylindrical  lens  CLl  at  plane 
XI  expands  each  bit  of  'a'  horizontally  to  illuminate  SLM2  such 
that  the  multiplications  take  place;  the  spherical  lens  SLl 
focuses  the  light  vertically  on  plane  X3  to  perform  the 
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summation.  A  cylindrical  lens  CL2  at  X3  expands  each  bit  of  the 
intermediate  product  ab  to  be  incident  on  the  corresponding 
column  of  SLM3.  Spherical  lens  SL2  performs  summations 
vertically  again.  The  final  result  is  detected  at  plane  X5  using 
the  CCD  detector. 
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2)  Multiple  Matrix  Multiplication  (MMM) 


An  architecture  for  vector-matrix-matrix  multiplication  is 
first  described.  The  vector-matrix-matrix  multiplication  can  be 
written  as 


[xl  x21 

yll  yl2 

zll  zl2 

=  (xlyll+x2y21  xlyl2+x2y22] 

zll  212 

y21  y22 

z21  222 

z21  z22 

where  ul=xlyll+x2y21 ; 

u2=xlyl2+x2y22; 
vl=ulzll+u2c21 ; 
v2=ulz21+u2z22. 


=(ul  u2]  zll  zl2| 
z21  z22| 
=[u1z11+u2221  ul2l2+u2z22) 

=(vl  v21, 


(la) 

(lb) 

(lc) 
(2a) 
(2b) 
(2c) 
(2d) 


The  architecture  of  vector-matrix-matrix  multiplication  is 
shown  in  Fig. 2(a).  The  vector  [x]  is  encoded  on  SLMl,  and  two 
matrices  [Y]  and  [Z]  are  on  SLM2  and  SLM3  respectively.  Notice 
that  each  element  of  vector  (X]  and  matrices  [Y]  and  [Z]  is  in 
the  binary  form  described  in  Fig. 1(a).  All  the  multiplications 
for  tX]  X  [Y]  are  carried  out  between  plane  XI  and  X2  and  all  the 
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summations  are  performed  between  plane  X2  and  X3-  The  same 
procedures  are  repeated  between  X3  and  X4,  X4  and  X5  to  perform 
[U]  X  (ZJ. 


We  can  also  perform  the  multiple  matrix  multiplication  by 
using  this  architecture.  The  first  matrix 
IX]=  xll  xl2 
x21  x22 

is  decomposed  into  two  vectors  Xl=Ixll  xl2]  and  X2=[x21  x22]. 

The  computer  shifts  the  vectors  into  SLMl  sequentially.  At  the 
output  plane  the  CCD  detector  detects  each  corresponding  vector 
of  the  output  matrix  [V]  sequentially  as  shown  in  Fig. 2(b). 


However,  to  make  full  use  of  the  parallel  processing 
capability  of  the  optical  system,  an  improved  optical 
architecture  to  perform  MMM  in  parallel  is  proposed.  As  is  seen 
in  Figs. 3(a)  and  (b),  the  image  on  plane  x3  can  be  considered  as 
the  one  dimensional  Fourier  transform  of  the  input  signal  on 
plane  XI,  by  ignoring  the  existence  of  SLM2.  To  separate  the  two 
vectors  [ull  ul2]  and  [u21  u22]  at  the  focus  plane  X3,  two 
sinusoidal  gratings  with  different  frequences  fl  and  f2  are 
inserted  immediately  behind  the  two  input  vectors  [xll  xl2]  and 
|x21  x22].  The  two  frequences  are  carefully  chosen  to  get  an 
appropriate  separation  distance  h  between  vectors  [ull  ul2]  and 
[u21  u22]  on  the  X3  plane.  In  a  similar  manner,  two  sinusoidal 
gratings  are  placed  behind  the  two  vectors  [ull  ul2]  and  [u21 
u22]  at  plane  X3.  Two  separated  vectors  [vll  vl2]  and  [v21  v22] 
are  obtained  at  the  output  plane  X5  as  shown  in  Fig. 3(b). 
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Ve  have  discussed  the  optical  system  for  parallel  MMH 
utilizing  the  inner-product  method.  However,  in  some 
applications  such  as  bilinear  transformation,  the  input  signals 
are  entered  sequentially  and  the  transformation  matrix  is  large. 
The  large  size  devices  are  not  currently  available.  So  we 
introduce  another  hybrid  optical  system  which  combines  the 
systolic  array  engagement  method  with  the  inner-product  method. 
This  system  can  overcome  the  bottleneck  effect  due  to  the 
electro-optic  interfacing.  It  is  also  easy  to  decompose  the 
large  matrices  using  this  system.  The  optical  system  is 
controlled  by  a  microcomputer.  The  matrices  are  shifted  onto  the 
SLM's  (e.g.  Magneto  Optical  SLM's  (MOSLM's)  or  Liquid  Crystal 
Televisions  (LCTV's))  step  by  step,  as  shown  in  Fig. 4.  Here  each 
matrix  is  arranged  in  a  systolic  array  form.  Each  element  of  the 
matrices  is  encoded  in  the  binary  form  shown  in  Fig. 1(a).  The 
CCD  detector  performs  time  integration  of  the  output  signal.  For 
2x2  matrices  multiplication,  the  output  matrix  is  obtained  after 
four  steps. 


III.  Experiment  Demonstration 

Several  preliminary  experiments  are  carried  out  based  on  the 
proposed  optical  architectures.  The  first  one  is  a  triple  binary 
number  multiplier,  as  shown  in  Fig.l  and  Fig. 5.  A  white  light 
source,  two  cylindrical  lenses  with  focal  length  10mm  and  two 
spherical  lenses  each  with  focal  length  100mm  are  used  in  the 
setup.  Several  masks  with  aperture  size  2mm  are  used  instead  of 
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SLM's  to  prove  the  usefulness  of  the  architecture.  Figure  5(a) 
shovs  the  three  masks  representing  a  «  101,  b  =  110,  c  »  Oil 
respectively.  Figure  5(c)  shovs  the  output  signal  in  a  mixed 
binary  form  (abc  =  0122210)  displayed  on  an  oscilloscope.  After 
passing  through  a  thresholding  circuit  the  output  result  is 
quantized  and  sent  into  a  computer.  The  computer  further 
converts  the  final  result  into  binary  form  abc  =  1011010,  as 
shovn  in  Fig  5(d). 


The  second  experiment  is  for  vector-matrix-matrix 
multiplication.  The  three  masks  in  Fig. 6(a)  represent  the  vector 
[X]=[01000  00011]  and  two  matrices 


Figure. 6(c)  shows  the  horizontally  expanded  output  signals  in 
mixed  binary  forms  displayed  on  a  scope, 

[V]  =  [0001121001100  0001331011000). 

The  final  results  in  binary  forms  are  shown  in  Fig. 6(d), 

[V]  =  [0010001001100  0011011011000]. 


The  last  experiment  is  a  triple  matrix  multiplication  based 
on  the  architecture  described  in  Fig. 2(b).  The  three  matrices 
are 

[X]=  00100  01000  ;  [Y]=  00100  00001  ;  (Z]=  10000  00010  . 

00010  00011  00011  00010  01000  00110 
Figure  7(c)  shovs  the  horizontally  expanded  output  matrix  [V]  in 
mixed  binary  forms: 

[V]  .  0001121001100  0001331011000  . 

0000010132000  0000101102000 


1 01000  001101 


vv-.'v-.-vvv'.^ '#v' 

89 


00100 

00001 

[Z]=  10000 

00010  . 
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After  the  output  data  is  detected  by  the  CCD  camera,  it  passes 
through  a  thresholding  circuit  and  is  fed  into  a  microcomputer. 
The  computer  finally  converts  it  into  binary  form  as  shovm  in 
Fig.  7(d): 


[V] 


0010001001100  0011011011000 


0000011100000  0000101110000 


IX.  Conclusion 

Ue  have  presented  a  technique  that  can  perform  multiple 
binary  number  multiplication  in  parallel.  Based  on  this 
technique  tvo  optical  architectures  for  multiple  matrix 
multiplication  are  developed.  Since  the  matrices  are  in  binary 
or  mixed  binary  form  and  the  processing  is  performed  in  parallel, 
these  systems  have  the  capability  to  perform  high  accuracy  and 
high  speed  multiple  matrix  multiplication.  Several  preliminary 
experiments  using  photographic  masks  have  been  carried  out. 
Future  research  vill  involve  the  hybrid  optical  system  using 
real-time  SLM's.  The  optical  system  vill  be  controlled  by  a 
microcomputer.  These  architectures  can  also  be  applied  to  linear 
and  bilinear  transformations  (The  application  to  bilinear 
transformation  vill  be  discussed  in  a  forthcoming  paper). 
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Figure  Captions 


Fig.  1:  Optical  system  for  triple  binary  number 
multiplication:  a)  the  basic  architecture,  b)  the  optical 
implementation,  c)  top  view  of  the  system,  d)  side  view  of  the 
system. 

Fig.  2;  Architecture  for  vector-matrix-matrix 
multiplication. 

Fig.  3:  a)  Optical  system  implementation  of  MHM.  b) 
Architecture  for  MMK. 

Fig.  4:  Architecture  for  MMM  utili2ing  the  systolic-inner 
product  method. 

Fig.  5;  a)  Three  masks  for  triple  binary  number 
multiplication.  b)  Output  signals  detected  on  plane  X5.  c) 
Result  displayed  on  an  oscilloscope  in  mixed  binary  form.  d) 
Final  result  in  binary  form. 

Fig.  6:  a)  Three  masks  for  vector-matrix-matrix 
multiplication.  b)  Output  signals  detected  on  plane  X5.  c) 
Output  vector  [vl  v2]  displayed  on  an  oscilloscope  in  mixed 
binary  form,  d)  Final  output  vector  [vl  v2]  in  binary  form. 

Fig.  7:  a)  Three  masks  for  MMM.  b)  Output  signals 
detected  on  plane  X5.  c)  Output  matrix  [V]  in  mixed  binary  form, 
d)  Final  output  matrix  [VJ  in  binary  form. 
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Optical  Perfect  Shuffle  Using  Spatial  Filtering 
Q.W.  Song  F.T.S.  Yu, 

Electrical  Engineering  Department 
The  Pennsylvania  State  University 
University  Park,  PA  16802  USA 


One  of  the  inherent  advantages  of  the  optical  computer  is  its  noninteractive  inter¬ 
connecting  capability.  The  optical  perfect  shuffle  (PS)  which  forms  the  basis  of  such 
an  interconnection  network  is  a  useful  concept  in  optical  computer  architecture.  Re¬ 
cently,  proposals  of  optical  PS  have  been  made  by  Goodman  et  al  [l]  and  Marchic  [2] 
for  the  application  to  VLSI  systems  and  single-mode  optical  fibers,  respectively.  More 
recently,  Lohmann  et  al  have  implemented  the  optical  PS  with  the  use  of  four  prisms 

(3] .  In  this  letter,  we  shall  demonstrate  that  two  sets  of  data  can  be  shuffled  using  an 
optical  spatial  filter.  An  experimental  demonstratioin  is  also  provided. 

Originally,  the  term  PS  is  referred  to  a  method  of  shuffling  cards.  As  demonstrated 
in  Fig.  1,  the  upper  half  of  data  are  removed  and  then  interlaced  with  the  lower  half. 
We  note  that  this  shuffling  of  data  can  be  quickly  achieved  by  optical  spatial  filtering 

[4] .  Examples  of  PS  applications  to  FFT  and  sorting  algorithms  have  been  discussed 
by  Stone  [5]  and  Parker  (6). 

The  optical  system  to  perform  PS  is  depicted  in  Fig.  2.  Two  sets  of  data  are 
designated  by  si(i,y)  and  52(1, y),  which  are  seperated  by  a  distance  20  at  the  input 
plane  Pi.  With  coherent  illumination,  the  complex  light  distribution  at  the  spatial 
frequency  plane  P2  can  be  described  as 


£(P,<1)  =  5i(p,9)e"‘^’  +  S2{p,q)e'^‘’,  (1) 

where  5i(p,9)  and  S2{p,q)  are  the  Fourier  spectra  of  the  input  data  si(i,  y)  and 
S2(i»y).  respectively.  To  implement  perfect  shuffle,  we  would  place  a  sinusoidal  grating 
in  the  Fourier  plane  ^2-  We  assume  that  the  grating  function  is 


H{q)  =  -{l  +  cos\{0  +  ^P)q\},  (2) 

where  A0  is  a  small  displacement  constant.  Thus,  the  output  intensity  distribution  on 
P3  can  be  shown  as 


I{x,y)  =  ^I«i(i,y  -  0)\^  +  ^ls2{i.y +  /?)l’  +  -  ^0)  +  «2{i.y  + 

+  7|5i(i,y  -  20  -  A^)l^  +  ^132(2:, y  +  20  +  A0)\^. 
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From  the  third  term  of  Eq.  (3),  we  see  that  si{x,y)  and  52(i,y)  are  slightly  shifted 
on  opposite  directions  along  the  Y  axis.  If  the  incremental  shift  A0  is  equal  to  the 
separation  between  the  processing  data,  then  Sj  and  S2  would  be  perfectly  interlaced. 
Thus,  the  two  sets  of  input  data  would  be  perfectly  shuffled. 

In  our  experiment,  we  used  two  sets  of  English  letters  as  imput  data  for  demon¬ 
stration.  Figure  3(a)  shows  the  input  data.  Figure  3(b)  gives  the  output  shuffled  data, 
obtained  with  the  proposed  technique.  We  note  that  if  two  optical  filtering  systems  are 
cascaded  in  tandem,  the  PS  operation  can  be  applied  to  a  2-D  data  array,  such  that 
one  shuffles  horizontally  and  the  other  vertically,. 
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A  high  accuracy, 
high  date  rate, 
electrO’Optical  architecture 


A 

*?>  gM  i^t  weight  and  pocket 

B  size,  the  optical  signal 

M  processor  can  perform 

H  a  myriad  of  complicated 

processing  operations. 
It  success  is  primary  due  to  the  pro- 
Vfound  diffranion  phenomena  of 
« coherent  hghi.  Tne  essential  merit  of 
■“^an  optical  signal  processor  must  be 
the  capabihty  of  processing  the  signal 

Sin  complex  amplitude,  parallelism, 
large  capacity,  high  speed  and 
wavelength  diversity.  Several  process¬ 
ing  operaiiom  have  proven  to  be 
more  effiaen:  with  optical  lechmoues 
^than  with  their  elearonic  counter¬ 
parts.  These  operations  are:  Fourier 
transformers,  convolution  and  cor- 
relation  operations,  spectrum 
y*  analysis,  and  others.  However,  op¬ 
tical  signal  processors  are  very  infiex- 
ibie  compared  with  elearonic  com- 

Sputers.  The  major  advantage  of  an 
electronic  computer  must  be  the  flex¬ 
ibility,  programmability  and  easy  ac- 
y.  cessability.  The  Question  is  "Can  we 
exploit  the  effiaent  ooerauon  of  the 
’  optics  and  the  flexibility  o.'  the  elec¬ 
tronic  computer  to  come  ur  with  a 
m  more  realistic,  but  no:  futuristic, 
H  eiearo-optica!  (EO)  archiieaurt  to 
mea  our  computational  neeos?"  Tne 
answer  to  this  question  is,  “yes." 
vj  First,  let  me  point  out  that  tne 
^5  earlier  development  of  eiearoiuc 
computer  was  based  on  state-of-inr- 
ar:  technology  available  at  mat  unt. 
fy  It  was  a  very  realistic  approach  tan: 
<y  we  should  adopt  for  the  development 
of  our  electro-optical  computa.  Se- 
cond,  the  current  optical  signal  prc>- 
V  cessor  can  be  regarded  as  a  highly  ef- 
"*  ficient  processmg  system,  for  exam¬ 
ple  a  high  performance  vehicle. 
However,  without  human  interven- 
tion,  the  vehicle  cannot  perform  pro¬ 
perly.  In  order  for  an  opuca!  signal 
processor  to  function  efficiently,  we 
r,*  introduce  an  elearonic  computer  to 
^ •’  lend  a  hand.  Tne  intervention  of  an 
electronic  computer  is  not  for  dau 
processmg.  Rather,  its  purpose  is  to 
jj*  contf  ol  the  electro-optical  oevices  so 
data  can  be  primarily  processed  by 
the  opucal  processor.  Thus,  high  ac- 
curacy  and  high  dau  rate  processing 
•V  can  be  achieved  by  the  eiearo-optical 
computer. 


Digital-Optical  computing 

Credit  for  the  first  opucal  architec¬ 
ture  proposed  to  carry  out  matru- 
veaor  multiplication  must  be  given 
to  J.  W.  Goodman.  They  used  a  iign: 
emitting  diode  fLED)  to  generate  a 
ume  sequence  veaor  and  with  a 
binary  mask  to  control  the  vanabie 
opemngs  represenung  a  matru  for¬ 
mat  to  perform  matrix-vecior 
multiplicauon.  A  similar  LED.  but 
with  higher  accuracy  opticl  arcnitec- 
ture  for  matrix-veaor  operauon.  was 
later  aeveioped  by  others.  The>'  utilu- 
ed  a  linear  array  of  LED  to  generate 
an  input  veaor  and  array  of  acousto- 
opric  cells  to  represent  a  matrix  for¬ 
mulation  of  veaor-mamx  mulupuca- 
tion.  To  avoid  the  interfacing  dif¬ 
ficulties,  still  others  imroouced  a 
systolic  array  processing  concept  for 
opucal  matnx-matiix  muluplication. 

However,  the  analog  nature  o'  the 
optical  processing  techniques  limits 
tne  accuracy  of  the  operations.  To 
alleviate  this  problem,  digital 
representation  was  imroouced. 
Multipiymg  two  numbers  on  a  dig:'- 
by-digit  basis,  a  numerical  multipuci- 
uon  tecnnioue  was  demonstrated  tna: 
can  be  performed  with  optical  cor*- 
voluuon  operauons.  Next,  tne  cor- 
cept  of  implementing  a  real-time 
convolution-based  muluplicauon  was 
mtroQueed.  tne  idea  bemg  an  outer 
proauc  technioue  with  correlauon 
mainces.  Tncre  are  a  numoer  of  a- - 
chiieoures  proposed  to  exnioi:  tne 
parallelism  of  optics  whicn  can  be 
found  in  a  survey  paoer  o>  R.  A. 
Athaie.  (See  Read  more  about  iti. 

Matrix-Matrix  multiplication 

To  exploit  the  parallelism  of  op- 
ucal  processmg,  an  electro-optical 
(EO)  processor  is  shown  in  Fig.  1. 
This  EO  architecnire  utilizes  an  outer 
produa  technique  for  matnx-znatnx 
muluplication. 

Figure  Z  shows  the  outer  produc 
computation.  When  the  row  anc  col¬ 
umn  eiecirooes  of  a  two-dimensional 
_  (programmabiei  eiectro-opuc  spatial 
light  moouiaior  (SLM).  is  adaressed 
by  two  binary  vectors  c  and  c,  such 
as 


C„„  ovoU^bl.  .0  DTIC  do«  »« 
panoil  hill»  leOtbU 
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the  corresponding  outer  product 
would  be 
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0  1  1 

It  is  clear  now,  that  t  matrix* 
matrix  multiplication  can  be  com¬ 
puted  by  successive  outer  produa 
operations,  as  can  be  seen  in  the 
following  lustration. 
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Such  compuiauons  can  also  be  used 
to  carry  oui  the  multiplication  of  two 
arbitrary  matrices  by  appropriate 
decomposition  and  summing. 

Since  a  multipbcation  between  two 
single  bits  is  equivalent  to  a  logic 
operation  AND,  an  outer  produa 
operation  can  be  earned  out  with  a 
Magneto-Optic  (MO)  SLM.  In  other 
words,  the  row  and  column  electrodes 
of  the  MOSLM  can  be  addressed  with 
two  binary  veaon  a  and  b,  and  the 
outer  produa  C  can  be  directly 
evaluated. 

With  reference  to  the  EO  architec¬ 
ture  of  Fig.  1.  the  grating  in  the 
Fourier  plane  diffracts  the  outer  pro¬ 
ducts  of  A£,  from  the  MOSLM,  to 
form  an  elementary  2x2  matrix  at 
the  origin  of  the  output  plane.  As  an 
example,  a  2  x  2  elementary  matrix 
C  K  A£  representation  of  a  16  x  16 
extended  binary  matrix  is  seen  in  the 
experimental  result  shown  in  Fig.  3. 
Ihus,  a  higher  order  matrix 
multiplication  can  be  obtained  oy 
decomposing  the  matrices  into  a 
number  of  elementary  2x2  matrices 
and  then  performing  the  basic  matrix 
multiplication  opucally. 
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Symbolic  Logic  Processing 
Basic  optical  logic  array  processing 
has  been  reponed  recently.'* * 
programmaoie  opucai  symbolic  logic 
processor  can  be  consmiaed  as  shown 
in  Fig.  4.  A  collimated  light  is  used  to 
Oluminate  three  cascaded  SLMs.  Toe 
produa  of  their  generated  panems  is 
then  imaged  omo  a  charge  coupled 
device  (CCD)  area  deieaor.  The  out¬ 
put  CCD  data  are  then  fed  to  elec¬ 
tronic  “OR”  circuits,  before  being 
stored  in  a  high  speed  memory 
subsystem. 


As  an  exampk,  a  binary  input  pat- 
tem  A  is  subdivided  into  N  x  NanaO 
regions  ca&ed  “logic  cells.*’  To  per¬ 
form  the  logic  operatioa.  the  value  aij 
(0  or  1)  of  each  Ijth  cell  are  encoded 
with  binary  patterns,  as  shown  in  the 
top  row  of  Fig.  5  (a).  We  then  utilis 
a  2  X  2  pixel  of  the  SLM  for  each 
logic  cell.  The  other  binary  input  pat¬ 
tern  B  is  encoded  in  a  nmiiar  manner, 
as  shown  in  the  bottom  row  of  Fig. 
5(a).  These  encoded  binary  patten  can 
be  generated  with  a  miaocompuier 
memory  subsystem.  The  encoded  pat¬ 
terns  of  A  and  B  are  then  written  in¬ 
to  the  SLMl  and  SLM2,  respective¬ 
ly.  Since  SLMl  and  SLM2  are  close¬ 
ly  cascaded,  the  combination  states  of 
aij  and  bjj  are  represented  by  the  pat¬ 
terns  shown  in  Fig.  5(b).  A  logic 
operation  in  one  channel  is  also 
represented  by  a  2  x  2  pixel  pattern 
of  the  SLM3.  (a,B,y,S)  represents  the 
switching  sutes  (0  or  1)  of  the  pixels 
of  a  logic  mask  as  shown  in  Fig.  5(c). 
Thus,  the  combinations  of  these  2  x 
2  pixel  logic  cells  would  provide  a  total 
of  16  logic  gates. 

A  CCD  area  daeaor  is  used  to 
transform  the  optical  signal  from 
every  pixel  (afia  the  hght  passes 
through  the  cascaded  SLM)  into  ar¬ 
rays  of  electrical  signals.  The  four  pix¬ 
el  signals  of  a  logic  cell  can  be  com¬ 
bined  with  a  Transistor  Transistor 
Logic  (TTL)  “OR”  gate.  Thus,  a 
logic  operation  resulting  from  a  logic 
ceil  can  be  expressed  as 
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cj,j  ■  o(aijbij)  +  0(aijbij)  + 

T<aijbi,j)  T  ^aijbij), 


where  "WBd  -  stand^for  eompiemenr^ 
logic  “OR”  operation^. 
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The  spatial  representations  of  the 
sixteen  lopc  gates  and  the  resulting 
panems  are  shown  in  Fig.  6.  Since  the 
final  result  of  Cm  is  represented  by  an 
eieoncal  signal^,  it  can  be  directly 
nored  in  the  memory  subsystem, 
which  can  be  used  m  the  next  cycle  of 
operation. 

It  should  be  noted  that  the  arm- 
binauons  of  the  16  logic  funedons  are 
the  fundamentals  of  the  anthmetic 
operauons  of  a  digital  computer.  It  is 
obvious  thai  the  proposed  technique 
has  the  ability  to  perform  the 
anthmeuc  operaaon  of  two  input 
panems. 
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cTU  considered  is  veaors.  the 
above  equation  c«n  be  represented  m 
matrix  form,  that  is 
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or  abbreviated  as, 

tSnO  “  Ihm.nllWi 

where  U 

transform  mainx.  Thus,  the 
DLTs  would  have  different 
transform  matrices.  We  shall  now 
illustrate  a  few  srequently  used 
DLTs: 

Discrete  Fourier  Transform  (OFT) 

The  DFT  is  defined  by 

r  .  -  fn  expl^mn],  0  i  m  S  n  -  1, 

N  n-O  N 

where  W.expi:i^l“’^° 

W 

known  as  the  transform  kernel.  To 
implement  the  DFT  transfonnauon 
in  an  eiectro-opiical  processor,  we 
shall  present  the  complex  u^iorm 
matrix  in  real  elements.  The  cor¬ 
responding  real  transform  mauices 
r-jin  be  written  as 


Re  [hm.nJ 


,  2«nn , 
cos  I _ _  1. 

N 


.liwicie  '  , 

/imother  frequently  used  linear 
srmttfonnatioo  is  Chiip-Z  transfot^ 
which  can  be  used  to  compute  tK 
DFT  eoefficiems.  The  d®**^®*^ 
DCZT  transform  matrix  can  be  wrn- 

ten  as 

hnun  “ 

We  note  that  this  type  of 
invariant  transformauon.  as  well  as 
other  types  of  DLTs.  can  be  im- 
nlemenicd  by  an  electro-opucal  pro- 
with  a  systolic  array  process¬ 
ing  technique. 

Since  the  discrete  linear  transfor¬ 
mation  can  be  viewed  as  the  result 
from  a  matrix-vertor  roultiphcauon. 
the  systoUc  array  processmg  juchuec- 
ture  can  be  used  for  the  implementa¬ 
tion  of  DLT.  Thus,  by  combining  the 
systolic  array  processmg  technique 
and  the  two's  complement  represen¬ 
tation.  a  DLT  can  be  performed  with 
an  eiectroKjpucal  processor  as  shown 
in  Fig.  8.  This  technique  has  a  high 
—accuracy  and  low  enor  rate  proc^ 
ing  capability  and  i:  is  compauble 
with  other  diptal  proctors. 

An  txainpic  of  DLT  using  the 
svsiolic  array  processing  “ 

iilustratcd  in  Fig.  9.  In  Fig. 
three-sample  poinu  discrete  cos^ 
transform  (DCD  matrix  is  encode 
in  the  two’s  complement  form,  ano 
multiplied  with  an  input  veaor  usmg 
the  systolic  array  metho^ 
sine  transformation  {DSD. 
out  by  the  systolic  array  method,  is 
shown  in  Fig.  9(b).  Thi«. 
ing  DCT  and  DST  of  Figs.  9(a)  and 
9(b),  a  discrete  Fourier  transform  can 
be  obtained. 
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and 


,  .  ,  2*mn  , 

lmlhm,n]  -  I  — 


which  are  the  well-known  discrete 
cosine  transform  (DCT)  and  discrete 
sine  transformation  (DST). 

Oiscrate  Hllbarf  transform  (DH7) 
It  is  well-known  that  the  reiauon- 
ship  between  the  real  and  imaginan' 
oarts  of  an  analytic  signal  can  be 
dmcribed  by  the  Hilbert  tnmsfonna- 
uon.  The  elements  of  a  discrete 
Hubert  transform  (DHT)  matrix  can 
be  wnnen  as 

sinMrim-nl.'T]  ^ 

“  im-nj 


m  -  n  «  0  , 
m  -  n  »  0 
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Concluding  Romarks 
Sineg  MC^LM  can  be  addressed  in 
pati«l  puallel  mode,  the  whole  frame 
pattern  on  MOSLM  can  be  switched 
in  a  very  rapid  manner,  for  example 
64>sfora64  x  64  MOSLM:  51.2 
for  a  312  x  512  MOSLMjTBy 
iitniTing  a  high  speed  memory  sub¬ 
system  (the  technology  b  available) 
with  a  spedally  designed  interfacing 
circuit,  a  relatively  slow  microcom¬ 
puter  can  be  used  to  manipulate  the 
parallel  operation  of  the  MOSLMs. 
Thu  b  known  as  a  single  instruction 
multiple  data  (SIMD)  operation.  In 
addition,  with  the  introduction  of  a 
microcomputer  into  the  system,  a 
man-machine  communication  link  b 
also  provided.  To  generate  the  systolic 
array  formats  rapidly,  a  table  look  up 
structure  b  suggest^.  After  the  time 
integrating  CCD  deteaor,  a  high 
speed  analog  to  digital  converter 
(ADC)  and  a  serial-parallel  defor- 
maier  would  be  used.  Thus,  by  ex¬ 
ploiting  the  programmability  of  the 
computer,  various  linear  algebraic 
operauoru  can  be  performed  with  thu 
hybrid  optical  architeaure. 

Finally,  by  exploiting  the  efficient 
operation  of  optics  and  the  program¬ 
mability  of  electronic  computer,  it  b 
the  author's  belief  that  hybrid  optical 
architeaure  would  be  the  logic^  ap¬ 
proach  toward  modern  optical  com¬ 
puting.  However,  much  remaiiu  to  be 
done  in  the  development  of  electro- 
optical  devices  before  the  hybrid  op¬ 
tical  computing  can  become  a 
widespread  practical  reality.  We  hope 
thu  article  will  stimulate  interested 
readers  to  produce  more  imaginaiive 
hybrid  optical  computing  appbcauons 
in  the  future. 
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Tabu  I 

ADC  —  analog  to  digital  convener 

CCD  —  ctiarge  couoled  device 

DCT  —  discrete  cosine  transtoimation 

OCZT  —  discrete  chirp  ■  z  tianstormation 

DFT  —  discrete  Fooner  Tianstormation 

DHT  —  discrete  Hilbert  Tianstormation 

OLT  —  discrete  linear  transtormation 

OST  —  discrete  sine  tianstonnation 

EO  —  eiectro«ptical 

led  —  light  emitting  diode 

MO  —  magnetooDtic 

MOSLM  —  magneto-optic  spatial  light 
moouiator 

SIMD  —  single  instruaion  multiple  data 
SLM  —  spatial  light  modulator  _ 

TTL  —  transistor-transistor  logic 
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1*1.  Concluding  Remarks 

Optical  signal  processor  can  perform  a  myriad  of  complicated 
processing  operations.  Its  success  is  primarily  due  to  the  profound 
diffraction  phenomena  of  coherent  light.  The  essential  merit  of  an  optical 
signal  processor  must  be  the  capability  of  processing  the  signal  in  complex 
amplitude,  parallelism,  large  capacity,  high  speed  nad  wavelength  diversity. 
Several  processing  operations  have  proven  to  be  more  efficient  with  optical 
techniques  than  with  their  electronic  counterparts.  These  operations  are: 
Fourier  transformers,  convolution  and  correlation  operations,  spectrum 
analysis,  and  others.  However,  optical  signal  processors  are  very 
inflexible  compared  with  electronic  computers.  The  major  advantage  of  an 
electronic  computer  must  be  the  flexibility,  programmability  and  easy 
accessabllity .  The  question  is  "Can  we  exploit  the  efficient  operation  of 
the  optics  and  the  flexibility  of  the  electronic  computer  to  come  up  with  a 
more  realistic,  but  not  futuristic,  electro-otpcial  (EO)  architecture  to 
meet  our  computational  needs?"  The  answer  to  this  question  is,  "yes." 

First,  let  us  point  out  that  the  earlier  development  of  the  electronic 
computer  was  based  on  state-of-the-art  technology  available  at  that  time. 

It  was  a  very  realistic  approach  that  we  should  adopt  for  the  development 
of  our  electro-optical  computer.  Second,  the  current  optical  signal 
processor  can  be  regarded  as  a  highly  efficient  processing  system,  for 
example  a  high  performance  vehicle.  However,  without  human  intervention, 
the  vehicle  cannot  perform  properly.  In  order  for  an  optical  signal 
processor  to  function  efficiently,  we  introduce  an  electronic  computer  to 
lend  a  hand.  The  intervention  of  an  electronic  computer  is  not  for  data 
processing.  Rather,  its  purpose  is  to  control  the  electro-optical  devices 
so  data  can  be  primarily  processed  by  the  optical  processor.  Thus,  high 


accuracy  and  high  data  can  be  primarily  processed  by  the  optical  processor. 
Thus,  high  accuracy  and  high  data  rate  processing  can  be  achieved  by  the 
electro-optical  computer. 

It  is,  however,  our  believe  that  hybrid  optical  processing  (e.g., 
microcomputer  based  optical  processing)  would  be  the  logical  approach 
toward  modern  optical  computing.  However,  much  remains  to  be  done  in  the 
development  of  electro-optical  devices  before  the  hybrid  optical  computing 
can  become  a  practical  reality.  Nevertheless,  I  believe  that  hybrid 
optical  signal  processing  is  at  the  threshold  of  widespread  application.  I 
hope  that  this  report  will  serve  the  basic  foundation,  already  established 
in  part,  to  lead  the  interested  readers  to  produce  more  imaginative  hybrid- 
optical  processing  and  computing  applications. 
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